-- Logs begin at Sat 2021-08-21 11:34:04 UTC, end at Sat 2021-08-21 12:45:16 UTC. -- Aug 21 12:02:06.889931 dv-cinder-805477-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 21 12:02:06.898519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: open("./http_plugin.so"): No such file or directory [core/utils.c line 3732] Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: !!! UNABLE to load uWSGI plugin: ./http_plugin.so: cannot open shared object file: No such file or directory !!! Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: open("./python3_plugin.so"): No such file or directory [core/utils.c line 3732] Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: !!! UNABLE to load uWSGI plugin: ./python3_plugin.so: cannot open shared object file: No such file or directory !!! Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: *** Starting uWSGI 2.0.19.1 (64bit) on [Sat Aug 21 12:02:06 2021] *** Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: compiled with version: 7.5.0 on 21 August 2021 11:56:53 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: nodename: dv-cinder-805477-2-iscsi Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: machine: x86_64 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: clock source: unix Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: pcre jit disabled Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: detected number of CPU cores: 4 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: current working directory: / Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: detected binary path: /usr/local/bin/uwsgi Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: your processes number limit is 47843 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: your memory page size is 4096 bytes Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: detected max file descriptor number: 2048 Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: lock engine: pthread robust mutexes Aug 21 12:02:06.898972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: thunder lock: enabled Aug 21 12:02:06.900524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 21 12:02:06.900524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Python version: 3.6.9 (default, Jan 26 2021, 15:33:00) [GCC 8.4.0] Aug 21 12:02:06.945417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Python main interpreter initialized at 0x564b0c8f2500 Aug 21 12:02:06.945417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: python threads support enabled Aug 21 12:02:06.945417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: your server socket listen backlog is limited to 100 connections Aug 21 12:02:06.945417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: your mercy for graceful operations on workers is 90 seconds Aug 21 12:02:06.945835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 12:02:06.945835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: *** Operational MODE: preforking *** Aug 21 12:02:06.946113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: *** uWSGI is running in multiple interpreter mode *** Aug 21 12:02:06.946113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: spawned uWSGI master process (pid: 66161) Aug 21 12:02:06.946257 dv-cinder-805477-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 21 12:02:06.946667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: spawned uWSGI worker 1 (pid: 66162, cores: 1) Aug 21 12:02:06.947640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: spawned uWSGI worker 2 (pid: 66163, cores: 1) Aug 21 12:02:06.947640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 12:02:09.852444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Aug 21 12:02:09.852979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Aug 21 12:02:09.853083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Aug 21 12:02:09.853187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Aug 21 12:02:09.853742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] command line args: [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Aug 21 12:02:09.853881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] command line args: [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Aug 21 12:02:09.854086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Aug 21 12:02:09.854194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Aug 21 12:02:09.854288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ================================================================================ {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Aug 21 12:02:09.854374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ================================================================================ {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Aug 21 12:02:09.854556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] admin_token = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.854652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] admin_token = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.854831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_dir = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.854927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_dir = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_source = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] config_source = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] debug = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] debug = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.855939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.856008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.856008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.856133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_config_append = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_config_append = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.857936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_dir = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_dir = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_file = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_file = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.858977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.859928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.860081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.860181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.860329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.860433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.861179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.861451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.861451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.861738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.862215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.862309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.862499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] publish_errors = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.862594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.862756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] publish_errors = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.863945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] standard_threads = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] standard_threads = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_journal = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.864938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_json = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_stderr = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_syslog = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_journal = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_json = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.865911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.866015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_stderr = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.866114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] use_syslog = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.866208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.866368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Aug 21 12:02:09.866461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.866657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.866750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.866927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.867990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.868875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.869947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.870981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.871912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.872924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.873974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.874888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.interface = admin {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.875875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.interface = admin {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.876916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.877894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.878975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.879902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.880977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.881964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.882908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.883995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.884927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.885919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.external = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.886995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.external = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.password = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.887979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.token = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.password = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.888910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] auth.token = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.889883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.890954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.891887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.892956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.893923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.894868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.895994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.896924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.897887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.898824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.899996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.900925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.901886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.902820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.903926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.904992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.905988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.906917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.907061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.907194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.907808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.907947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.908881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.909966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.910913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.911982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.912470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.912604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.912761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.912896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.913978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.914914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.915964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.916875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.917907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.918983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.919906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.920971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.921939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.922869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.923659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.923804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.923937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.924918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.925872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.926946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.927873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.928930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.929924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.930938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.931868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.932935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.933891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.934963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.935894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.936952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.937897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.938989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.939914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.940865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.941866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.942939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.943871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66163) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Aug 21 12:02:09.944926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Aug 21 12:02:09.944926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66162) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Aug 21 12:02:09.967725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.967919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.968024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.968197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.968292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.968471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.979007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:09.979352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.008827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.009043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.009140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.009312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.125139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.125386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.177821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.178102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.178841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.179114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.247739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.248854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.249003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.249101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.249246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.274784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.274976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.275912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.276002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.276137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.276245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.288648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.289011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.300848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.301986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.302080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.302171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.302328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66163) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.302425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.302566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66162) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 12:02:10.322176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.322312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.322410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Aug 21 12:02:10.322503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Aug 21 12:02:10.322755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.322852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.322984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Aug 21 12:02:10.323079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:437}} Aug 21 12:02:10.323444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.323539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.323740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.323838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.324029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.324125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.324314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.324417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.336644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.336751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.336955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.337050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.337253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.337361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.337570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.337666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.347416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.347522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.351020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.351120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.351335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.351429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.351652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.351758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.351968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.352966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.353903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.354091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.354252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.383148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.383327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.384844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.385063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.385158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.385375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.391141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.391321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.391457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.392134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.392286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.392446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.400229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.400339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.400564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.400666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.405398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.405497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.405723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.405835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.406972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.407067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.407922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.408023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.408229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.408331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.429329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.429498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.429643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.429844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.435059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.435181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.439519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.439623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.439844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.439938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.445558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.445667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.449577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.449676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.453888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.453998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.454736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.454842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.455978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.456084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.478255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.478373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.478571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.478666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.478877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.478973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.479171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.479266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.489295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.489395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.491286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.491385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.491597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.491692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.495548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.495672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.495858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.495954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.496875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.511870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.511980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.512195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.512291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.512514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.512609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.512825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.512927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.513892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.534707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.534813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.538251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.538361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.542018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.542115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.543790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.543885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.545594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.545702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.545925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.546022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.546353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.546447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.554330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.554442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.556069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.556172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.559590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.559694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.559919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.560015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.560231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.560326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.560532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.560633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.571535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.571854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.572176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.572471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.572789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.573109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.581475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66162) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.581812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.582128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.582388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66163) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:350}} Aug 21 12:02:10.582484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.582697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.582792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.583726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.584942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.585089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.585254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.585402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.585564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66162) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.585709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.586031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.586331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.586640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66163) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:420}} Aug 21 12:02:10.628160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x564b0c8f2500 pid: 66162 (default app) Aug 21 12:02:10.629043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x564b0c8f2500 pid: 66163 (default app) Aug 21 12:02:10.632218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db452-1ac2-49ee-9c59-ecac5d9fa5ac None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:10.632568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db452-1ac2-49ee-9c59-ecac5d9fa5ac None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:10.632905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24db452-1ac2-49ee-9c59-ecac5d9fa5ac None None] PATH_INFO: `/v3` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:10.637213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 782 bytes} [Sat Aug 21 12:02:10 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:16.500688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511568d-6647-4cdf-b33c-c002aab5195b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:16.501207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511568d-6647-4cdf-b33c-c002aab5195b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:16.501382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511568d-6647-4cdf-b33c-c002aab5195b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:16.506965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:16 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:02:16.512593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:16.512936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:16.513269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:16.555922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG oslo_db.sqlalchemy.engines [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=66162) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Aug 21 12:02:16.708808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG passlib.handlers.bcrypt [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] detected 'bcrypt' backend, version '3.1.7' {{(pid=66162) _load_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:567}} Aug 21 12:02:16.709259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG passlib.handlers.bcrypt [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66162) _finalize_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:382}} Aug 21 12:02:16.769824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:16.771427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:16.870406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:16.958899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:16.959238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:16.959565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:17.006902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG oslo_db.sqlalchemy.engines [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=66163) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Aug 21 12:02:17.124885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG passlib.handlers.bcrypt [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] detected 'bcrypt' backend, version '3.1.7' {{(pid=66163) _load_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:567}} Aug 21 12:02:17.125274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG passlib.handlers.bcrypt [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66163) _finalize_backend_mixin /usr/local/lib/python3.6/dist-packages/passlib/handlers/bcrypt.py:382}} Aug 21 12:02:17.171883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:17.173517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:17.182134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:17.188528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:17.200413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713004c9-b06b-499e-a981-e32f9c282aa6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:17.207431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:17.208090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:17.208426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:17.208762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:17.217189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:17.260989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 12:02:17.261380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047edc-4981-4876-86ca-33e08d592ba8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:17.272152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:17 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:17.278608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:17.291367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde61af-6d0b-415d-8d86-f2d2c5cbe209 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:17.295680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:17.296549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:17.296887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:17.297220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:17.299044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ce60da1aac441c9b29c109feb2ce1b7)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:17.342079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 12:02:17.342463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bb8ea-c44a-4b78-a927-ba03a227a407 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:17.347093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 3/6] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:17 2021] GET /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:19.310067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e9ff-9c18-448c-bd3a-0b61b03a1407 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:19.310543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e9ff-9c18-448c-bd3a-0b61b03a1407 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:19.310644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3e9ff-9c18-448c-bd3a-0b61b03a1407 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:19.315838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 4/7] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:19 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:19.321443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433869de-c693-4f54-a763-892a263d86d2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:19.321804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433869de-c693-4f54-a763-892a263d86d2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:19.322154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433869de-c693-4f54-a763-892a263d86d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:19.346927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-433869de-c693-4f54-a763-892a263d86d2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:19.348455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-433869de-c693-4f54-a763-892a263d86d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:19.355715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:19.376849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:19.377190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:19.377517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:19.402492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:19.404022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:19.411649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:19.417248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433869de-c693-4f54-a763-892a263d86d2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:19.426715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433869de-c693-4f54-a763-892a263d86d2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:19.430887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:19.431521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:19.431856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:19.432184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:19.440501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:19.469129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5e1a-f9be-492c-b8e3-1e36f1fb279a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:19.478698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:19.484152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:19.492848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1e70d-3cdd-4bba-84ef-de4ffec4d756 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:19.497313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:19.498198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:19.498529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:19.498862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:19.501035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:19.529597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f6ff5-e74a-48b8-b94c-e04dd630282f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:19.531157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 6/11] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:19 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:02:21.481939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09237-74a3-4c7f-b818-2239b9545eec None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.482446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09237-74a3-4c7f-b818-2239b9545eec None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.482567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a09237-74a3-4c7f-b818-2239b9545eec None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.484389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 6/12] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:21.490328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.490666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.490992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.514803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:21.515998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:21.522942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:21.544373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.544719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.545050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.569000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:21.570218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:21.577118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:21.582358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:21.591750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2adf946-0338-46d0-a51b-ede3a2815603 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:21.596041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:21.596840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.597178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.597507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.610779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:21.618031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:21.619211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:21.625147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:21.634628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54a3bf-6b7e-4d4c-8e9f-5dc178400f45 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:21.638809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:21.639457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.639793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.640123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.640916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:21.641310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:21.668688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:21.668688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:21.668688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:21.669681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:21.682433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:21.687749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:21.698529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc72a57-ad1b-407a-9d13-5f1dc6c34700 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:21.702673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:21.703520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.703886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.704210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.705393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:21.732973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:21.734509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:21 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:21.740134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:21.749497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7c79e-c14b-45d8-b9c8-c6265e0f9086 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:21.754308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:21.755083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.755420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.755749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.756906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:21.784684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33353b47-df13-4f1f-a2d8-1af413f32ff6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:21.786295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:21.791476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:21.801518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5aa2a-7e65-4bae-b712-5db14d17c053 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:21.805725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:21.806379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:21.806718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:21.807051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:21.807917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.domain.id=default, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:21.808272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:21.835857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:21.835857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:21.835857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:21.837155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231573-c444-4b92-bfd1-6ceba5502f1d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:21.842925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1334 bytes} [Sat Aug 21 12:02:21 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.domain.id=default&role.id=90f6703d946e4169827377b5a8ffae62 => generated 233 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:23.787780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7165d-9738-44f2-8109-a3bf869bc84d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:23.788308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7165d-9738-44f2-8109-a3bf869bc84d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:23.788434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7165d-9738-44f2-8109-a3bf869bc84d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:23.790288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 10/20] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:23.795641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:23.795987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:23.796315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:23.819795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:23.820986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:23.827938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:23.850545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:23.850891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:23.851224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:23.874040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:23.875218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:23.882193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 11/22] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:23.887470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:23.897204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550ead9-d7be-4c4e-b2ff-c8358f2513f8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:23.901301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:23.902117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:23.902450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:23.902777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:23.914886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:23.922067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:23.923208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 12/23] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:23.928978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:23.937718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f66f9-b702-4911-a4e5-cb1b53145a70 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:23.942172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:23.942813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:23.943147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:23.943478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:23.944268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:23.944615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:23.973815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:23.982909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 12/24] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:23.988578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:23.998725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23faed-39c3-420d-ad27-76dcb42626b0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:24.002833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:24.003701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:24.004034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:24.004361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:24.005538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:24.034227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:24.035774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 13/25] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:23 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:24.041095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:24.050667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059c022-88d8-44cb-8264-d5e614e47cb2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:24.054827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:24.055615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:24.055992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:24.056326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:24.057493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:24.087036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691a295-2033-42d0-a588-021d22d1f0e0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:24.088613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:24.094179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:24.103785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd76373-d032-497f-9d4f-34e0a2d19291 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:24.107886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:24.108746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:24.109080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:24.109418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] PATH_INFO: `/v3/domains/default/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:24.111386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2ba5d31461a040c292e70a0ffe9aec5b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:24.138495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:24.138495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:24.138495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:24.140670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808f8f3-0d2a-4426-9696-0a138c3aaf3f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:24.441421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1373 bytes} [Sat Aug 21 12:02:24 2021] PUT /identity/v3/domains/default/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:02:26.379616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bf7d-0dd8-403c-a7d9-a8b8ca051d76 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.380095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bf7d-0dd8-403c-a7d9-a8b8ca051d76 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.380193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923bf7d-0dd8-403c-a7d9-a8b8ca051d76 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.382007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 14/28] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:02:26.390414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.390777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.391121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.420777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:26.423104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:26.490328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 15/29] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:26.512520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.512860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.513188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.536753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:26.537962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:26.544835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:26.550686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:26.560255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455849e-f312-4a98-8244-f2f877f2d4b5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:26.564676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:26.565560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.565929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.566262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.577917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:26.585335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:26.586583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 16/31] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:26.592417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:26.601725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330654-1804-42db-a037-2fcd8755e92b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:26.605936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:26.606576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.606907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.607230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.608011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:26.608353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:26.636509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:26.645622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 16/32] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:26.650873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:26.661279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f70e-3dc9-425b-88a6-35c6e6de9b5b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:26.665357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:26.666224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.666557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.666885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.669710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:26.698851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:26.704045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 17/33] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:26 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:26.709274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:26.718622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72297e-f5cd-4ca9-8a8d-7b9bb883d489 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:26.723283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:26.724059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.724391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.724718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.725889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:26.753238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049296a-e331-48a3-8b45-e8a3ac06c8cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:26.754770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:26.760090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:26.770170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823486e1-4901-4c0f-8931-526e44fb24a5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:26.774273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:26.774913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:26.775252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:26.775583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:26.776485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.domain.id=default, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:26.776841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:26.805173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b882c-e5bd-4fcc-b93a-1c59717e2625 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:26.811306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 18/35] 10.222.0.18 () {56 vars in 1334 bytes} [Sat Aug 21 12:02:26 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.domain.id=default&role.id=90f6703d946e4169827377b5a8ffae62 => generated 530 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:28.797288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440aca-b1c5-47a4-ba44-b7acdda5bd56 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:28.798346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440aca-b1c5-47a4-ba44-b7acdda5bd56 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:28.798566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0440aca-b1c5-47a4-ba44-b7acdda5bd56 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:28.800380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 18/36] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:28.805700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:28.806081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:28.806422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:28.829802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:28.831021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:28.837998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:28.859587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:28.859930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:28.860259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:28.883534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:28.884710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:28.892099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:28.897422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:28.907395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa000-9443-4d3b-85b5-b94230a990b8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:28.911563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:28.912198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:28.912538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:28.912870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:28.920917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:28.948871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886928-7273-455e-9af5-3eade6ca035f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:28.958936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:28.964289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:28.974297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89efe-ec12-42fb-abc6-196abeb4dbb4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:28.978490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:28.979287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:28.979622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:28.979953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:28.981119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:29.008860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b2275-526d-4efb-9529-56714f9c837f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:29.010472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 20/40] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:30.984843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e62e7-aa99-43c6-9189-7202c8702914 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:30.985365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e62e7-aa99-43c6-9189-7202c8702914 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:30.985505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e62e7-aa99-43c6-9189-7202c8702914 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:30.987513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:30.993009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:30.993424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:30.993867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:31.018208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:31.019408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:31.026423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:31.048263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:31.048603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:31.048937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:31.072379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:31.073560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:31.081192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:31.086415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:31.096349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cfaa9-efc6-4a5e-ba85-0720153ba0ef None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:31.101436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:31.102260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:31.102600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:31.102931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:31.117948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:31.147312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:31.166241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:02:31.167480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:31.174570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:31.183678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084c9fa-4acf-455e-b974-6d1f796aa470 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:31.188771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:31.189443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:31.189782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:31.190152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:31.190946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:31.191296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:31.218276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:31.218276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:31.218276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:31.219287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea3be6-829b-4643-9c46-a5bab99c0772 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:31.232578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:02:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:31.238731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:31.249001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6f255-8771-4945-9e96-5e1fa7716e17 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:31.253618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:31.254285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:31.254618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:31.254945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:31.255682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:31.282442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:31.282442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:31.282442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:31.283754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b290bf-fe59-408d-80a4-afc31224bead admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:31.574989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:02:31 2021] POST /identity/v3/projects => generated 301 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:02:33.551559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6aa5-ceee-49a6-a814-3ecf3da800c9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:33.552074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6aa5-ceee-49a6-a814-3ecf3da800c9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:33.552221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6aa5-ceee-49a6-a814-3ecf3da800c9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:33.554122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:02:33.561909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:33.562270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:33.562611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:33.591263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:33.592947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:33.664489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:33.686395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a9e20-4666-4073-ba01-557dcadd32c5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:33.686735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a9e20-4666-4073-ba01-557dcadd32c5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:33.687069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a9e20-4666-4073-ba01-557dcadd32c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:33.710657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f70a9e20-4666-4073-ba01-557dcadd32c5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:33.711870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f70a9e20-4666-4073-ba01-557dcadd32c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:33.718830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 25/49] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:33.724562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:33.734148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f66d1-bf15-4bfd-af45-6da52523e8ff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:33.738435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:33.739128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:33.739470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:33.739803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:33.740637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:33.769254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:33.769254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:33.769254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:33.770351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c978ba-de95-4ce0-948b-7002a916d894 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:33.836275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 25/50] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:02:33 2021] POST /identity/v3/roles => generated 219 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:35.797567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4102-f3ee-4d5f-820d-4b5e66c47b53 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:35.798205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4102-f3ee-4d5f-820d-4b5e66c47b53 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:35.798205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4102-f3ee-4d5f-820d-4b5e66c47b53 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:35.800052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 26/51] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:35.805655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:35.806038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:35.806371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:35.830041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:35.831232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:35.838194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 26/52] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:35.859381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b34ff-2485-43ee-b471-e3fa026d8c28 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:35.860222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b34ff-2485-43ee-b471-e3fa026d8c28 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:35.860555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b34ff-2485-43ee-b471-e3fa026d8c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:35.883601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fc8b34ff-2485-43ee-b471-e3fa026d8c28 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:35.884779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fc8b34ff-2485-43ee-b471-e3fa026d8c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:35.891655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 27/53] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:35.896795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:35.906079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40935fed-7ef0-4430-90e8-37becd63498e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:35.910450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:35.911118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:35.911461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:35.911793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:35.912575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:35.941476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76249fc1-7b4a-4157-b2dd-8bbdc7dc7a7c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:35.981769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 27/54] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:02:35 2021] POST /identity/v3/roles => generated 225 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:37.943833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7954b-3046-4d42-beaa-ccf6aac8d67d None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:37.944377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7954b-3046-4d42-beaa-ccf6aac8d67d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:37.944470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7954b-3046-4d42-beaa-ccf6aac8d67d None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:37.946341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 28/55] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:37.951958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:37.952307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:37.952642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:37.976960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:37.978220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:37.985192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 28/56] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:38.006768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e317-31dc-4024-a171-a8d1999412d5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:38.007119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e317-31dc-4024-a171-a8d1999412d5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:38.007456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712e317-31dc-4024-a171-a8d1999412d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:38.030656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8712e317-31dc-4024-a171-a8d1999412d5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:38.032506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8712e317-31dc-4024-a171-a8d1999412d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:38.039511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 29/57] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:38.044784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:38.054217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed90f6-e990-4c39-8f47-2132c4f5f2f6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:38.058309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:38.058968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:38.059303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:38.059633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:38.060400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:38.088838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95448d8e-a8c2-4e1a-9914-e69008ade751 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:38.130112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 29/58] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:02:38 2021] POST /identity/v3/roles => generated 223 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:40.087114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d9b6-33c4-4a75-b6a9-2e81026669e5 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:40.087605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d9b6-33c4-4a75-b6a9-2e81026669e5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:40.087777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d9b6-33c4-4a75-b6a9-2e81026669e5 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:40.089627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 30/59] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:40.095051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:40.095395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:40.095724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:40.118940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:40.120134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:40.127618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 30/60] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:40.149829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:40.150233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:40.150569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:40.173525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:40.174739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:40.181646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 31/61] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:40.186835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:40.196764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed80335-f456-4d1c-90ef-43f42a9b3e4f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:40.200933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:40.201776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:40.202151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:40.202476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:40.204553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:40.232387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1fd0-fd56-4e90-b23b-81d002ff459a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:40.233939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 31/62] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:40.239614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:40.248448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb2ac3-af86-41aa-83a5-741d68ab0416 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:40.253177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:40.253854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:40.254194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:40.254527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:40.255263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:40.282186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:40.282186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:40.282186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:40.283524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb35359-722f-4b78-b8d2-a6d6b2dc575c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:40.341741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 32/63] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:02:40 2021] POST /identity/v3/projects => generated 312 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:42.311320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456074-f14e-45e5-9b90-4024c8cb0e9a None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:42.311822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456074-f14e-45e5-9b90-4024c8cb0e9a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:42.311925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11456074-f14e-45e5-9b90-4024c8cb0e9a None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:42.314097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:42.319664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:42.320014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:42.320348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:42.345054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:42.346289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:42.413087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:42.435392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:42.435739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:42.436075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:42.459862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:42.461063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:42.468113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:42.474097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:42.483460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ce051-794d-4cdc-8d55-5f2b7eb55d44 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:42.487607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:42.488409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:42.488749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:42.489083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:42.490298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:42.519055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4a22e-9782-4ca8-a442-1def96c26f47 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:42.520612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 34/67] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:42.525882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:42.535380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf90c79-43fb-491b-8304-4dd31fb2a095 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:42.539526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:42.540184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:42.540521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:42.540852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:42.541580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:42.569864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc89dd-b7c2-4473-8f48-51b845753512 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:42.616283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:02:42 2021] POST /identity/v3/projects => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:44.585937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd7b2-689d-4156-9a72-0df0b401ae08 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:44.586482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd7b2-689d-4156-9a72-0df0b401ae08 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:44.586568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdd7b2-689d-4156-9a72-0df0b401ae08 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:44.588394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 35/69] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:44.593972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:44.594324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:44.594659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:44.617271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:44.618491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:44.683839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:44.706447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53886-6291-477d-8aa2-677625763690 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:44.706797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53886-6291-477d-8aa2-677625763690 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:44.707139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e53886-6291-477d-8aa2-677625763690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:44.730201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d6e53886-6291-477d-8aa2-677625763690 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:44.731396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d6e53886-6291-477d-8aa2-677625763690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:44.738866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:44.744238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:44.754263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac704a4-8bb5-4138-948a-f4f3b950109a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:44.758467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:44.759262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:44.759601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:44.759935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:44.761100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:44.789179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5044643-d6cd-4e55-9705-95c4fd209159 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:44.790821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 36/72] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:02:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:44.795784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e53886-6291-477d-8aa2-677625763690 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:44.805042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e53886-6291-477d-8aa2-677625763690 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:44.809148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:44.809804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:44.810158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:44.810492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:44.811225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:44.839092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:44.839092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:44.839092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:44.840385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb11ba-6b48-47e9-8e3a-d67507d7b082 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:44.998502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 37/73] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:02:44 2021] POST /identity/v3/users => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:02:46.989909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d239-d261-4ca7-a055-aea6c16b50ad None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:46.990409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d239-d261-4ca7-a055-aea6c16b50ad None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:46.990541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65d239-d261-4ca7-a055-aea6c16b50ad None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:46.992572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 37/74] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:46.998281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:46.998632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:46.998969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.022518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:47.023732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:47.030836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:47.053002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.053352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.053684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.077638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:47.078933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:47.085915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:47.091121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.100460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e25dc-0728-481d-9f6c-5400f1de653a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.104567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.105367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.105703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.106065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.118058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:47.125891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:02:47.127088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:47.132921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.141714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916fa41-47a3-460c-b6c9-7161143a75f5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.145928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.146577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.146915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.147248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.148060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] RBAC: Adding query filter params (name=member) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:47.148411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:47.176691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:47.185702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:47.192077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.202306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c2334-cce8-4940-a5b6-e57121e91785 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.206573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.207430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.207771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.208102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.227183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:47.256603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:47.258195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:47.263550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.273195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c7798-27d9-4667-b6ee-e902196a0bad admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.277346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.278011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.278350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.278684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.287227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:47.315961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:47.324740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 40/80] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:47.330107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.339439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f97047-b54c-49ce-bd6d-3f6c55a5840a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.343997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.344831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.345165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.345489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.346692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:47.375221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4684f6-9707-4d15-8411-75234b592b87 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:47.376817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:47.382299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:47.391040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd50c85-5f22-48b0-b87a-afb3aa14df5b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:47.395265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:47.395908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:47.396251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:47.396588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:47.397477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:47.397863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:47.426229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:47.426229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:47.426229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:47.427518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff791aa9-a668-414b-8a87-50feee476afb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:47.433553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 41/82] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:02:47 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:49.382986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e416-f273-4b51-b696-25516ea5186b None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.383469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e416-f273-4b51-b696-25516ea5186b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.383570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e416-f273-4b51-b696-25516ea5186b None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.385376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 42/83] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:49.391271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.391623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.391958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.415659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:49.416861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:49.423904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 42/84] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:49.445105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.445447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.445779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.469768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:49.470996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:49.477887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:49.483105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:49.492515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c20b3d-3f0a-4de0-9022-c34d4d34c48d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:49.497613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:49.498448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.498787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.499118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.510916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:49.518907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:02:49.520119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:49.526246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:49.535688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176f5df-f279-4e51-bb2e-eafb3cf1643b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:49.539872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:49.540518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.540852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.541182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.542002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:49.542355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:49.569989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:49.569989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:49.569989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:49.570986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:49.581409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:02:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:49.586737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:49.598757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170b8b8-59a9-4e1c-90d9-0d75ad3ccd7f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:49.603022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:49.603895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.604235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.604567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.606731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:49.635553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:49.637128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 44/88] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:49 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:49.642927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:49.652262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804433f8-3bb3-48c7-ae8a-7b693952e075 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:49.656470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:49.657331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.657668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.658030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.659251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:49.688126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d936-24e1-41a9-b3f0-6dc28df20c22 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:49.689874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:49 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:49.694959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:49.705052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f503-d50b-4320-b848-ff5ac6f6a630 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:49.709208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:49.710104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:49.710440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:49.710766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:49.712701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597b9d90cb1469eba0dcced76f27109, user_id=d9c872fcf7bd4f71b8f819a9ced93c00, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:49.739731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:02:49.739731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:02:49.739731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:02:49.741923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a9fc-6c8e-46e5-a6e6-98f348fd43af admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:49.786451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:02:49 2021] PUT /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:02:51.752324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be226-49c5-48f2-869c-a1def4cfd51a None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:51.752863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be226-49c5-48f2-869c-a1def4cfd51a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:51.752952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728be226-49c5-48f2-869c-a1def4cfd51a None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:51.754847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 46/91] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:51.760363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326756-379b-459a-b451-e1ddb580723c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:51.760712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326756-379b-459a-b451-e1ddb580723c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:51.761048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5326756-379b-459a-b451-e1ddb580723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:51.784727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a5326756-379b-459a-b451-e1ddb580723c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:51.785971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a5326756-379b-459a-b451-e1ddb580723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:51.851435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 46/92] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:51.874053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:51.874398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:51.874786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:51.897916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:51.899112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:51.906663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 47/93] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:51.911823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326756-379b-459a-b451-e1ddb580723c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:51.921167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5326756-379b-459a-b451-e1ddb580723c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:51.926001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:51.926799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:51.927140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:51.927471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:51.939408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:51.946791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:02:51.947942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 47/94] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:51.953960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:51.962782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8ecd-9e91-495f-950d-a819091b9e45 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:51.967046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:51.967710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:51.968059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:51.968890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:51.969692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:51.970081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:51.998456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:52.007713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 48/95] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:02:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:52.013475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:52.023610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db727b3e-a6b3-4eec-915f-7c5080b9c06b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:52.027746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:52.028612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:52.028949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:52.029277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:52.030486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:52.059848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:52.061394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 48/96] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:52 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:52.066965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:52.076509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a2e-8bf9-4a8a-b3e6-700f95c3ab1c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:52.080662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:52.081295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:52.081635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:52.082000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:52.090029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:52.119616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:52.130545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 49/97] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:52.136200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:52.146381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ca4be-b885-47cd-9ba1-07f728b1db24 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:52.150536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:52.151396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:52.151731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:52.152058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:52.153232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:52.182031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf773a-be91-4791-b719-431d96ea3443 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:52.183734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 49/98] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:52 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:52.189796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:52.198605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5ed9a-a92b-4ae0-a1d1-c89341f9086c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:52.203376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:52.204014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:52.204354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:52.204685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:52.205561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:52.205954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:52.234532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726a614-2ddb-4e7f-a37b-7d6fc6233341 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:52.240491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 50/99] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:02:52 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:54.258424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63d63-51bc-4b10-9665-51416024bf3d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.258906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63d63-51bc-4b10-9665-51416024bf3d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.259007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63d63-51bc-4b10-9665-51416024bf3d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.260819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 50/100] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:54.266925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.267279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.267617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.290893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:54.292083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:54.299044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 51/101] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:54.321292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.321630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.321989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.345460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:54.346675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:54.353577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 51/102] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:54.358921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.368341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207e7ac-ba03-4a12-8f7d-1df40fd7189a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.372479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.373273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.373611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.373996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.386043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:54.393866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:54.395019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 52/103] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:54.400861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.409622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042076ab-019c-4cb1-9856-80cf37364970 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.413739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.414440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.414775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.415105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.415892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:54.416239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:54.445288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:54.454081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:54.459293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.469050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb22e04-a694-41b8-bf9f-679341709600 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.473148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.474009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.474346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.474675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.475853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:54.505196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:54.506767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:54.511965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.521209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37286d3-e773-4915-a52f-1009148a558d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.525304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.525949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.526285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.526615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.534567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:54.563686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:54.572398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 53/106] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:54.577591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.586972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4929-86c8-443c-b007-e05cc2391b99 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.591067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.591890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.592225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.592553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.593734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:54.622608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae92d0b-9cec-4e62-a4b4-4d21d65627ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:54.624255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 54/107] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:54.630580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:54.639599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057835-6154-4199-acdc-38b807e34c36 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:54.643928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:54.644611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:54.644950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:54.645283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:54.646192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:54.646556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:54.690125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9bc3a-af88-4ea7-8f85-bdde8ef090d1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:54.695812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 54/108] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:02:54 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:56.663551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270cd9-6e9d-4ce9-85dc-d024abcf0b92 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.664065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270cd9-6e9d-4ce9-85dc-d024abcf0b92 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.664209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270cd9-6e9d-4ce9-85dc-d024abcf0b92 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.666110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 55/109] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:56.672089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.672436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.672768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.696724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:56.697946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:56.704953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 55/110] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:56.726586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.726937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.727275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.752654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:56.753875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:56.760913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 56/111] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:56.766321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:56.775688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f4170-8200-4d65-95e2-5f0710b9a28d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:56.779831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:56.780628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.780981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.781309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.792906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:56.800709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:56.801874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 56/112] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:56.807752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:56.817478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea415141-52ea-4956-870c-30dcb67695c4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:56.821657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:56.822349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.822694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.823028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.823819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:56.824170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:56.852012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:56.861414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 57/113] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:56.866812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:56.877357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4af2b1-e583-4221-ad41-4ab79265ae85 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:56.881554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:56.882426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.882767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.883102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.884287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:56.912257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:56.913865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:56 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:56.918899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:56.928753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3cf2-f101-4376-8c0a-b483af2cea65 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:56.932907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:56.933756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.934388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.934388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.936560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:56.965529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75d08f-b0ae-440d-acfc-a8657c129cd9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:56.971181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:56 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:56.976712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:56.987014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065beaa-9b5b-4cb9-a7e0-669e9a88ecc2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:56.991126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:56.992003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:56.992335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:56.992659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:56.994594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597b9d90cb1469eba0dcced76f27109, user_id=2ba5d31461a040c292e70a0ffe9aec5b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:57.024453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f02e8d-66eb-4bb0-a62b-62ad8b023cc4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:57.089217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:02:56 2021] PUT /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:02:59.040103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662801c-f0b6-4939-b0d3-badd9fd968d3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.040547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662801c-f0b6-4939-b0d3-badd9fd968d3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.040757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662801c-f0b6-4939-b0d3-badd9fd968d3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.042621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 59/117] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:02:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:02:59.048104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.048455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.048791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.072162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:59.073365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:59.138667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 59/118] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:59.161463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.161839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.162240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.184971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:02:59.186178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:02:59.193234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 60/119] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:02:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:02:59.198453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.208285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c3d24-fd2f-48a0-b698-eecaf363518f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.212378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.213220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.213605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.213971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.226232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:02:59.233424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:02:59.234626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:02:59.240458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.249218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74234d-7d42-43c5-a873-a314efcd61c0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.253243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.253913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.254256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.254585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.255367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:59.255714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:59.284373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:59.293067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 61/121] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:59.298319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.308225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf906a-c68e-42a0-b72f-d7e05fa32d45 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.313048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.313917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.314250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.314573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.315741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:59.344158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:59.345690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:59.350769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.359994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee94a6-a522-4a75-a990-4565edaa5cd4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.364075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.364685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.365019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.365348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.373279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:59.402005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:59.410740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 62/123] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:02:59.415785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.425026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbad33-af6e-4ee2-9c30-bb2421512fa5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.429110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.429955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.430297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.430626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.431780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:59.461096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3daf82-a84f-4404-a8b1-bc8cb14fcf5c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:59.462788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:02:59.467911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:02:59.476351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374dafc-c2be-4c7b-acac-6a0ea63f6eaf admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:02:59.480440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:02:59.481049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:02:59.481385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:02:59.481717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:02:59.482603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:02:59.482959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:02:59.511592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d86c-0ef1-45f3-85d0-7ec5f0e4c6cd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:02:59.518100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:02:59 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:01.523322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9af1-9296-4ba0-b55f-c0f4a0695863 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.523857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9af1-9296-4ba0-b55f-c0f4a0695863 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.523945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a9af1-9296-4ba0-b55f-c0f4a0695863 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.525778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 63/126] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:01.531791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.532139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.532476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.556174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:01.557365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:01.564574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 64/127] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:01.586120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.586462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.586788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.611877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:01.613068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:01.620015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 64/128] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:01.625422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.635155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046c693-df79-4c69-9d82-d54cf850e3ec None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.639475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.640317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.640657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.640988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.653193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:01.661407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:01.662634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:01.669193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.678947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c528-3cbf-46d5-b19e-8fd7485a2c2c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.683076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.683738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.684072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.684401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.685190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:01.685535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:01.713500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:01.722716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:01.728113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.738755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ce9c-112b-4b4a-b554-b7f804475705 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.742928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.743778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.744118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.744451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.745644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:01.773952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:01.775485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:01.781286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.790918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89b860-67e4-4821-9b90-c3818aa956fc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.795117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.795750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.796089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.797027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.805148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:01.833293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:01.842274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 66/132] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:01.848137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.857747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b363d-22c5-4fc2-abd2-f578c6376788 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.862522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.863360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.863698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.864028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.865211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:01.893694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f575c-ce2d-4192-a94e-b2fd93bedba9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:01.895411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:01.900662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:01.909912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24c5c-4dd6-44df-8c4c-ef26693953f2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:01.914071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:01.914700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:01.915044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:01.915379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:01.916236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:01.916597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:01.944613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35211b-6a87-4c6e-bb86-84f5858dbd51 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:01.950143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:01 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:03.911297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7023a-6f77-423f-93b5-7022847befbe None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:03.911812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7023a-6f77-423f-93b5-7022847befbe None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:03.911956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7023a-6f77-423f-93b5-7022847befbe None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:03.913813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 68/135] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:03.919126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:03.919476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:03.919809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:03.943685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:03.944882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:03.951840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 68/136] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:03.974671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:03.975028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:03.975367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:03.998554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:04.000246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:04.007325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:04.012905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:04.023145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01855a-de15-464a-bf10-2e7a19186a0d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:04.027275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:04.028101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:04.028443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:04.028777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:04.040371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:04.048039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:04.049194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 69/138] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:04.055035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:04.064677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680f21-2a9e-4217-9b81-9b7910fd4388 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:04.068835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:04.069486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:04.069852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:04.070193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:04.070994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:04.071347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:04.099698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:04.108373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 70/139] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:04.113682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:04.123570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820a004-2125-4874-9d73-da0997bd7b5c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:04.128183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:04.129016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:04.129355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:04.129688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:04.130913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:04.159668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:04.161232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 70/140] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:04 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:04.166425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:04.176225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef608-a542-4041-aebb-d7577267757d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:04.180360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:04.181199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:04.181538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:04.181900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:04.183078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:04.212044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018088e-d5a0-432e-b775-6f7a5256cc5f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:04.213753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 71/141] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:04 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:04.218934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:04.228276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc007-5eec-497b-9587-b7865775e23d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:04.232396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:04.233249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:04.234105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:04.234435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:04.236579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597b9d90cb1469eba0dcced76f27109, user_id=d9c872fcf7bd4f71b8f819a9ced93c00, role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:04.265768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaebc35-6c29-4185-8b01-eec50cf6453e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:04.300961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 71/142] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:03:04 2021] PUT /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/8d3ffd13c75a4e7c952e828db384215e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:06.239150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de58c-2862-464b-9655-3220662922ce None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.239653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de58c-2862-464b-9655-3220662922ce None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.239778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98de58c-2862-464b-9655-3220662922ce None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.241627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 72/143] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:06.247167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.247470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.247801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.270769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:06.271968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:06.336999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 72/144] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:06.359833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.360177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.360516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.384118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:06.385348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:06.393413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 73/145] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:06.399343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.409936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d305d54-73bd-4eb3-90ed-d5d7514ec8b8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.414024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.414831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.415164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.415492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.427079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:06.434849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:06.436003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 73/146] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:06.442269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.451138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e306-f509-40d0-a87b-3f3a3709b6ac None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.456188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.456837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.457171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.457498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.458326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:06.458681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:06.487219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:06.496204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 74/147] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:06.501583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.511737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74fa06-3e62-4080-aedf-a7787937ee17 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.516404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.517250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.517583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.517936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.519120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:06.547916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:06.549452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:06.554582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.564432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02644b7-dd49-44aa-a970-b1bbd38070de admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.568606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.569225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.569561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.569918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.578432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:06.606680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:06.615356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 75/149] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:06.620596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.629975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09368111-d13f-459b-8555-8a276bd2955c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.634067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.634880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.635212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.635538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.636690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:06.665762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123433e-da19-4e8e-8b85-f1a39310f1d3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:06.667360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:06.672616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:06.681081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06a04-a05c-4ed1-81fe-681710428e42 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:06.685191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:06.685882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:06.686218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:06.686545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:06.687657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=1597b9d90cb1469eba0dcced76f27109, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:06.688018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:06.716275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dc766-74dc-4075-aef4-5b1c87e31dbe admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:06.722816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:06 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:08.726140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688f6a-b767-468d-865d-08a8f8890971 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.726673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688f6a-b767-468d-865d-08a8f8890971 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.726767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7688f6a-b767-468d-865d-08a8f8890971 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.728597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 76/152] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:08.734425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.734774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.735107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.758951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:08.768764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:08.768764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 77/153] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:08.788771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.789121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.789457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.813721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:08.814944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:08.821904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:08.827113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:08.836616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2bf186-d872-4a86-aae4-d4016afb8d80 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:08.840752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:08.841548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.841919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.842254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.853902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:08.861703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:08.862984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 78/155] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:03:08.868850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:08.878416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1710fc7-994a-4c9b-bc44-ccbd13f73650 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:08.882547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:08.883193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.883528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.883858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.884643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:08.884990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:08.912640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:08.921879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 78/156] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:08.927093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:08.937828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cf2b-2f56-463b-ae50-4cca901745a0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:08.941924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:08.942758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.943087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.943408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:08.944588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:08.973734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:08.979671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 79/157] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:08 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:08.980801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:08.991040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860076e-922c-478a-b6e2-417b8cefb633 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:08.995149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:08.995785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:08.996120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:08.996450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:09.005094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:09.034548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:09.043326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:03:09.049497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:09.059190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1dbf7-51fa-4c90-b4d7-c58bfcc9a510 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:09.063549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:09.064399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:09.064730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:09.065052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] PATH_INFO: `/v3/projects/f47a6963c1a74b259f6bdb1763812584` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:09.066274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=f47a6963c1a74b259f6bdb1763812584)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:09.095041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ffb27-0221-4ae8-a885-20462b2fc8c0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:09.096658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:09 2021] GET /identity/v3/projects/f47a6963c1a74b259f6bdb1763812584 => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:09.102212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:09.111556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa2200-a733-413f-a8ef-220be6a34e81 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:09.115733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:09.116365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:09.116702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:09.117035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:09.117933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=f47a6963c1a74b259f6bdb1763812584, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:09.118295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:09.146149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f46dbf-1ba7-4c20-ae33-d85d3bb8e865 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:09.151717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 80/160] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:09 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=f47a6963c1a74b259f6bdb1763812584&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:11.076347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01be02-0754-4dd0-86ec-a0aeb4785c1e None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.076839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01be02-0754-4dd0-86ec-a0aeb4785c1e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.076999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01be02-0754-4dd0-86ec-a0aeb4785c1e None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.079521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 81/161] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:11.084806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.085148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.085481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.109216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:11.110435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:11.117350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 81/162] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:11.138164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.138505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.138837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.162713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:11.163890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:11.170853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 82/163] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:11.176304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:11.185727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30303b2d-4432-415f-a5f8-ceecf7fda842 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:11.190189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:11.190981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.191313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.191636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.203647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:11.210933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:11.212085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:11.218757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:11.227595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fe7ee-b38d-4834-96b8-a51aed2464ea None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:11.231728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:11.232373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.232709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.233039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.233845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:11.234196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:11.261927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:11.271149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:11.276404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:11.287203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af3ff8-8f11-43a7-a716-7c4d6ddb08ea admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:11.291379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:11.292234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.292573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.292908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.294141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:11.323239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:11.324873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 83/166] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:11 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:11.330537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:11.339990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81b9b3-197e-4202-abe3-c673ef185027 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:11.344136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:11.344976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.345314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.345647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] PATH_INFO: `/v3/projects/f47a6963c1a74b259f6bdb1763812584` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.346856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] RBAC: Authorizing `identity:get_project(project_id=f47a6963c1a74b259f6bdb1763812584)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:11.375433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddea314-25ee-4003-8f56-684fec8b2852 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:11.377046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:11 2021] GET /identity/v3/projects/f47a6963c1a74b259f6bdb1763812584 => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:11.382230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:11.392179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544427cf-54eb-4f24-ba0f-8a99e222fb89 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:11.396326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:11.397179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:11.397519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:11.397881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] PATH_INFO: `/v3/projects/f47a6963c1a74b259f6bdb1763812584/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:11.399800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47a6963c1a74b259f6bdb1763812584, user_id=d9c872fcf7bd4f71b8f819a9ced93c00, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:11.428472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c965b-e628-41bb-8252-4e1007e3e0bf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:11.460289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 84/168] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:03:11 2021] PUT /identity/v3/projects/f47a6963c1a74b259f6bdb1763812584/users/d9c872fcf7bd4f71b8f819a9ced93c00/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:13.402700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b7a4-8ccb-4595-b861-2ea5cda88217 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.403185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b7a4-8ccb-4595-b861-2ea5cda88217 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.403366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295b7a4-8ccb-4595-b861-2ea5cda88217 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.405205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 85/169] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:13.410714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.411058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.411386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.434805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:13.435988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:13.504623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:13.526799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.527140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.527469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.551499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:13.552690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:13.559599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 86/171] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:13.565084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.574402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae8c77-c921-4caa-9a59-330cd4a5fe82 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.578535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.579322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.579654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.579982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.591534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:13.599304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:13.600446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:13.606562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.616012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd73dbf-8656-4bca-9e72-a01423545f11 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.620248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.620897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.621239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.621575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.622405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:13.622759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:13.650629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:13.660059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:13.665318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.752857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51646f36-d21e-44d9-873a-38bd864e17d5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.757269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.758169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.758504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.758833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.760028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:13.788717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:13.790334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:13.796870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.806717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e60a0-a87e-4dcc-addb-d1658e45f8bf admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.810874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.811522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.811867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.812204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.820569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:13.848904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:13.857761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:13.863764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.873401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d86a3-0d46-40c2-aebc-f9fe7742b2b8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.877597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.878481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.878822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.879150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] PATH_INFO: `/v3/projects/f47a6963c1a74b259f6bdb1763812584` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.880324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] RBAC: Authorizing `identity:get_project(project_id=f47a6963c1a74b259f6bdb1763812584)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:13.909479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc349ee-e269-4918-9933-a0e37eafd24f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:13.911246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 88/176] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/projects/f47a6963c1a74b259f6bdb1763812584 => generated 312 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:13.916642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:13.925421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b029da4-dd0e-4de4-b974-6b2c9391e76d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:13.929612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:13.930299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:13.930637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:13.930971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:13.931833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=f47a6963c1a74b259f6bdb1763812584, user.id=d9c872fcf7bd4f71b8f819a9ced93c00) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:13.932195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:13.961058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68598e37-e804-441d-9ab7-9b447034ab59 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:13.967186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 89/177] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:13 2021] GET /identity/v3/role_assignments?user.id=d9c872fcf7bd4f71b8f819a9ced93c00&scope.project.id=f47a6963c1a74b259f6bdb1763812584&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:15.943335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f2f1f-64e7-463f-b8cf-b0696bf6fcb2 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:15.943879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f2f1f-64e7-463f-b8cf-b0696bf6fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:15.943990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f2f1f-64e7-463f-b8cf-b0696bf6fcb2 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:15.945805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 89/178] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:15.951258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:15.951606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:15.951941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:15.976083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:15.977282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:15.984420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 90/179] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:16.006983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:16.007326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:16.007659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:16.031191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:16.032383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:16.039299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 90/180] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:16.044567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:16.054131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a92871-43d9-4a12-9707-e340d55f98ba None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:16.058490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:16.059297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:16.059639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:16.059980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:16.061150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:16.090459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7691f-42bc-4846-9b44-58690f5b8ae4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:16.092019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 91/181] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:03:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:16.097124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:16.105931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061c55b-533f-4863-9581-ad7a0f44fd55 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:16.110025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:16.110662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:16.110997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:16.111326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:16.112037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:16.141128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325b248-c11d-401b-9ff8-dc03fa94d480 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:16.193828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 91/182] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:03:16 2021] POST /identity/v3/projects => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:03:18.170135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1acb1-fae6-4f55-bd22-3b1839d18729 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:18.170636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1acb1-fae6-4f55-bd22-3b1839d18729 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:18.171335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1acb1-fae6-4f55-bd22-3b1839d18729 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:18.173160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 92/183] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:18.178726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:18.179082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:18.179402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:18.202599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:18.203801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:18.269810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 92/184] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:18.292382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:18.292726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:18.293067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:18.316910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:18.318126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:18.325049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:18.330377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:18.339826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959625c-fced-498e-b105-2103d6e6cdb3 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:18.344558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:18.345362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:18.345706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:18.346074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:18.347253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:18.375756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a1b1-87bc-404a-85dd-e701851b7cb3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:18.377301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:03:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:18.382362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:18.391660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fd667-83c5-464c-931c-2f94bc170b89 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:18.395822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:18.396471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:18.396812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:18.397150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:18.397920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:18.426605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fde438-47af-462f-85d1-09f8ea6e4f71 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:18.483500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 94/187] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:03:18 2021] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:03:20.486825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe93f-c507-40be-a206-8bad9e87d417 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.487354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe93f-c507-40be-a206-8bad9e87d417 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.487454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe93f-c507-40be-a206-8bad9e87d417 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.489298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 94/188] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:20.495276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.495625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.495958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.520219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:20.521430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:20.528407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 95/189] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:20.551225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.551573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.551912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.575295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:20.576487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:20.583476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 95/190] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:03:20.588565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.598479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993b5da-b7ad-4374-a21f-b1145e645a67 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.602592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.603384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.603724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.604055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.616245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:20.623530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:20.624720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:20.630636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.639875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed8e71-6b3d-4b16-b817-8de879237b49 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.644017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.644669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.645010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.645347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.646173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:20.646527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:20.674910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:20.683607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:20.689075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.777012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b59c4-2e4a-49a9-bd20-15fb1d06f9cb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.781822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.782704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.783063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.783397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.802139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:20.831057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:20.832659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 97/193] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:20.838613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.849172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a48b77-809d-43cd-a4bf-1dd7bf7618d4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.853357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.854033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.854377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.854713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.862887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:20.891467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:20.900353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 97/194] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:20.906253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.915573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbcfff-21ab-4389-8981-f7900da35a61 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.919691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.920535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.920872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.921202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.922422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:20.950745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498a1c8-399e-4590-a2e9-6410740909e2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:20.952833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:20.958427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:20.967274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157b591-4fa7-4b79-983f-131e63ec6bf6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:20.972060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:20.972701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:20.973041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:20.973374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:20.974302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:20.974667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:21.002636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612998c9-e165-4d06-87ba-09e77e9bd63b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:21.008403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:20 2021] GET /identity/v3/role_assignments?user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:22.961611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b263-128f-4761-8451-70c604438805 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:22.962198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b263-128f-4761-8451-70c604438805 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:22.962386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2b263-128f-4761-8451-70c604438805 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:22.964178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 99/197] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:22.969727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:22.970105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:22.970440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:22.994166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:22.995367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:23.003221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:23.024380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.024729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.025072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.048687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:23.049911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:23.056998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:23.063355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:23.072761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022df23b-e7e8-48d8-ba3b-113cc40ef8de None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:23.076907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:23.077701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.078066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.078398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.089961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:23.097287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:23.098459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:23.104449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:23.113860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf87fd-2ac5-474d-844b-1be54395d289 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:23.117978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:23.118624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.118961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.119291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.120087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:23.120433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:23.149673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:23.158460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:23.163701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:23.174117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aff1e-b68b-4be3-9ba4-18a067c01c10 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:23.178223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:23.179055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.179386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.179711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.180891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:23.210083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:23.211658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:23 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:23.216807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:23.226327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d3b7e-ce05-46b8-a1d2-8977d62c218b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:23.230483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:23.231325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.231665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.231998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.233722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:23.262395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a29d5-e9e1-44e3-a740-4e28ab332fde admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:23.264087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:23 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:23.269256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:23.278801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31222a-fbdc-41a1-98e2-ddc58efab252 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:23.283487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:23.284347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:23.284691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:23.285024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec/users/0b2a3a0c07804d7d84d3e31d65f4f6bb/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:23.287017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452435bde81148b5b2befd5c252b2cec, user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:23.316759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9b2ab-5a63-4eb1-a5a3-09162e6c4e76 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:23.375057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 102/204] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:03:23 2021] PUT /identity/v3/projects/452435bde81148b5b2befd5c252b2cec/users/0b2a3a0c07804d7d84d3e31d65f4f6bb/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:25.341882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4593ab-4e08-48e6-87e7-a3276fef615b None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.342892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4593ab-4e08-48e6-87e7-a3276fef615b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.342999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4593ab-4e08-48e6-87e7-a3276fef615b None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.344829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 103/205] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:25.350378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.350725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.351060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.374100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:25.375292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:25.440269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:25.462261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.462604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.462936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.486782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:25.487971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:25.495467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 104/207] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:25.500892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.510735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a26d-473c-4a7b-82b0-450441ca8c64 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.515910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.516728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.517063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.517392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.529354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:25.537226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:25.538442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:25.545018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.554149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242441-f9a4-4836-8d63-6f8b63e8512f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.558582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.559256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.559597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.559932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.560739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:25.561594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:25.590294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:25.599427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 105/209] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:25.604446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.616143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480abfd2-10a8-4e9a-886a-1c5d32879184 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.620261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.621103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.621437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.621764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.622990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:25.652071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:25.653683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 105/210] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:25.659000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.668472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bce5b1-5577-4867-beb9-d6d6a6f23192 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.672595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.673216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.673556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.673922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.681929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:25.711257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:25.720135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 106/211] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:25.725363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.734870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a476f-fd4f-466e-839d-bb10469bae14 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.739000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.739829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.740164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.740495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.741673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:25.770761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a517c-0d73-4cf0-8842-92ac98cdce2a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:25.772370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 106/212] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:25.777741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:25.786492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4b70f-5982-4549-b94a-9b70b7fd3427 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:25.790716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:25.791340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:25.791682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:25.792019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:25.792895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] RBAC: Adding query filter params (role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:25.793256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:25.821848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff270ba-beb7-4a75-87e4-2bb1df3ce97b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:25.828510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 107/213] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:25 2021] GET /identity/v3/role_assignments?user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:27.837272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9344-cb1b-4df9-9110-93e0eba72300 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:27.837837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9344-cb1b-4df9-9110-93e0eba72300 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:27.837943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae9344-cb1b-4df9-9110-93e0eba72300 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:27.839771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 107/214] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:27.845614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:27.845994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:27.846335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:27.870314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:27.871526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:27.878545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 108/215] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:27.900785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:27.901131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:27.901467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:27.925584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:27.926816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:27.933741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 108/216] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:27.939301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:27.948754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492741a-a621-4df6-aa21-ae7690d23166 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:27.952896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:27.953690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:27.954060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:27.954395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:27.966041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:27.973823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:03:27.975106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:03:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:27.981217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:27.990862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cce59c-4c8b-40de-b517-4869a166b282 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:27.995107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:27.995773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:27.996113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:27.996447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:27.997243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:27.997595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:28.025508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:28.035017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 109/218] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:28.040677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:28.051491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e7c2-e09e-49af-8bf6-ef6cc32f9955 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:28.055667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:28.056524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:28.056864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:28.057195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:28.058408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:28.086498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:28.088095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 110/219] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:28 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:28.093818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:28.103285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9de2-6f09-4959-92e7-ad7e27937aef admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:28.107355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:28.108022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:28.108866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:28.109195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:28.117153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:28.145456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:28.154185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 110/220] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:28.160271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:28.170157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e3cb6-6962-4f5d-9c80-baf9258c4fd3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:28.174350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:28.175219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:28.175551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:28.175876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:28.177065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:28.206073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc329aba-1f44-4e43-ae4d-71e2fcbe0f9e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:28.207723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 111/221] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:28 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:28.213773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:28.223595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee656f1-e23f-4345-86ae-5a6c068e8b8f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:28.227833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:28.228484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:28.228823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:28.229156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:28.230060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:28.230427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:28.258453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ee2f4-e6c4-4544-af1e-ea4049324213 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:28.264037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 111/222] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:28 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:30.199157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0af-cca3-4001-aee9-48b3b559b260 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.199643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0af-cca3-4001-aee9-48b3b559b260 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.199800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0af-cca3-4001-aee9-48b3b559b260 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.201633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 112/223] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:30.207202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.207553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.207890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.231618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:30.233423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:30.240415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 112/224] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:30.261646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.262000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.262338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.285696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:30.286923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:30.293814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 113/225] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:30.299594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:30.308924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26d61-aa49-4f93-bbac-6227a3c20504 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:30.313344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:30.314161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.314500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.314829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.326434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:30.333716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:03:30.334890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 113/226] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:03:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:30.340619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:30.349861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890ff37-bb4c-41c3-9c76-665027f5c6a1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:30.353952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:30.354588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.354921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.355251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.356031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:30.356377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:30.384595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:30.393875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:30.399092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:30.409562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e330a7-e9b1-47a3-a3bb-9d00ae3ece43 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:30.413686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:30.414549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.414886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.415218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.416401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:30.444524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:30.446093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:30 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:30.451184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:30.461067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732b7fe-4201-44fa-bcba-c7cb52821b02 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:30.465241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:30.466115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.466456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.466789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.468593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:30.497212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8408-0c45-4c3d-a780-12cc8ad11b90 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:30.499005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:30 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:30.504210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:30.513674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05650e13-11d2-458b-851d-662c325d01e7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:30.518286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:30.519148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:30.519484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:30.519813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:30.521713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=452435bde81148b5b2befd5c252b2cec, user_id=2ba5d31461a040c292e70a0ffe9aec5b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:30.550750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096afc52-894d-4616-826f-700e5646f5ac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:30.591372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 115/230] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:03:30 2021] PUT /identity/v3/projects/452435bde81148b5b2befd5c252b2cec/users/2ba5d31461a040c292e70a0ffe9aec5b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:32.530342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb3c-8e8d-4b2c-ad51-9786e699bd52 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.535691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb3c-8e8d-4b2c-ad51-9786e699bd52 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.535691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dbb3c-8e8d-4b2c-ad51-9786e699bd52 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.535691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 116/231] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:32.538395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.538749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.539088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.563492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:32.564697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:32.630247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 116/232] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:32.652560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.652908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.653241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.676714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:32.677926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:32.684772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 117/233] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:32.690358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.699780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09facd-4ae0-48f8-bfec-012d3c3bcfac None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.704497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.705294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.705639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.706005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.718402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:32.725764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:03:32.727051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 117/234] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:32.732834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.741527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984766f-972a-4e98-8a69-2a99e1ab6c0a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.745655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.746331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.746669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.746995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.747781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:32.748130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:32.776377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:32.785808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 118/235] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:32.790943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.801002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c90c1-8cd9-43b9-a0d2-1645bbefa54c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.805258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.806133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.806474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.806808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.808047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:32.836917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:32.838509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 118/236] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:32.844410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.853865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caf15a-e693-424b-ad1d-ae7d05dd0293 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.857986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.858607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.858943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.859272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.867208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:32.895344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:32.904163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:32.909889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.919373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abee992-03b6-4bfc-9eb1-c50dfc50588e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.923525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.924359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.924696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.925031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.926235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:32.955150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9941d22-a5a8-4d2a-86e3-920d801197d4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:32.956751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 119/238] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:32.962110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:32.971520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f805ef-19e9-434f-99c8-88eee65caca9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:32.975723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:32.976360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:32.976697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:32.977027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:32.977947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=2ba5d31461a040c292e70a0ffe9aec5b) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:32.978307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:33.006059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c1739-c222-4123-a1b3-446d880452c2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:33.012180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 120/239] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:32 2021] GET /identity/v3/role_assignments?user.id=2ba5d31461a040c292e70a0ffe9aec5b&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:35.031070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f551b-0207-42a0-9107-777bd0018a91 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.031548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f551b-0207-42a0-9107-777bd0018a91 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.031729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f551b-0207-42a0-9107-777bd0018a91 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.033564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 120/240] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:35.039069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.039420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.039757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.064252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:35.065439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:35.072370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 121/241] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:35.093801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.094171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.094503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.118184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:35.119360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:35.126904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 121/242] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:35.132156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.141468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461520a-eea0-40aa-b31c-9c80237b42b3 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.145613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.146447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.146784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.147112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.158612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:35.166388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:35.167607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 122/243] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:35.173750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.182480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c4ab-144c-4488-b9d5-8f4a23edcbe5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.187441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.188082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.188415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.188744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.189528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:35.189904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:35.217543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:35.226322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:35.231414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.242318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c22296-862b-4afc-86e7-6685891819e4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.246543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.247441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.247736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.248069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.249901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:35.278190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:35.280257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 123/245] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:35.285467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.294872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed238b-0ea7-4f5c-adab-ef05b457e9b0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.299619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.300242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.300581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.300911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.308897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:35.336909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:35.346277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 123/246] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:35.351430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.361416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c64ae1-d3f3-467c-8359-f2b520ef8522 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.365570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.366418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.366756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.367087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.368263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:35.396378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838d5eb-6bb9-49b3-8a3c-38f7bdfe0012 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:35.398006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:35.403403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:35.412614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34f42-0d01-40a1-8afa-05f140fbe753 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:35.416832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:35.417458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:35.417837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:35.418165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:35.419029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:35.419392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:35.448153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2064-27ee-4bc3-858b-36606f7d2826 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:35.453641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:35 2021] GET /identity/v3/role_assignments?user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:37.400485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29f22-5a24-40b8-87f6-26aea0854268 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.401050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29f22-5a24-40b8-87f6-26aea0854268 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.401160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f29f22-5a24-40b8-87f6-26aea0854268 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.402994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 125/249] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:37.408448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.408796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.409127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.432609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:37.433822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:37.441587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 125/250] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:37.462619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.462965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.463346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.486728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:37.487920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:37.496150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 126/251] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:37.502127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:37.511431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0144d-3749-4306-92e4-dea195bdd7ac None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:37.515509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:37.516317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.516653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.516982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.528446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:37.536660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:37.537834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 126/252] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:37.543711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:37.553196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6725d4-c9c3-42b4-837d-46bb9136a8dd None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:37.557354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:37.558046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.558388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.558724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.559517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:37.559873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:37.587953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:37.597171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 127/253] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:37 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:37.602269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:37.612989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05829e6-3d31-4773-b764-e645c87ddacf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:37.617122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:37.617994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.618327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.618652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.619831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:37.648140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:37.649757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 127/254] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:37 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:37.655431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:37.664702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca17b-180c-4be9-a667-1d2fa1f8c8cc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:37.668812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:37.669652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.670033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.670957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.672141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:37.700520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b7056-cc9f-40c4-845a-edbaada1f0b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:37.702174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 128/255] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:37 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:37.707342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:37.716797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002106c2-c71b-401a-904e-692d21cbff41 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:37.721489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:37.722379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:37.722717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:37.723049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec/users/0b2a3a0c07804d7d84d3e31d65f4f6bb/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:37.725204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=452435bde81148b5b2befd5c252b2cec, user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb, role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:37.754702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf97e75-c3c0-4a19-b8a2-5ffa9147c65c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:37.820338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 128/256] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:03:37 2021] PUT /identity/v3/projects/452435bde81148b5b2befd5c252b2cec/users/0b2a3a0c07804d7d84d3e31d65f4f6bb/roles/8d3ffd13c75a4e7c952e828db384215e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:39.776755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e18f-767e-4039-8b58-adddb837d523 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:39.777289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e18f-767e-4039-8b58-adddb837d523 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:39.777394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4e18f-767e-4039-8b58-adddb837d523 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:39.779248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 129/257] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:39.785306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:39.785660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:39.786026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:39.809391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:39.811124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:39.879353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 129/258] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:39.902388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:39.902735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:39.903071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:39.926256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:39.927454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:39.934452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 130/259] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:39.940601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:39.950116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c242d-0825-4b04-850d-8a9c77e6f21f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:39.955081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:39.955897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:39.956241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:39.956576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:39.968368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:39.976122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:39.977310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 130/260] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:39.983606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:39.992749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afce95-3a12-4a59-aef2-b336ec55bc10 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:39.996991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:39.997989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:39.997989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:39.998854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:39.999657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:40.000014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:40.028521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:40.037304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 131/261] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:40.042904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:40.053074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224483ff-077e-45ba-b57c-0e7f7e6f8d4c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:40.057267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:40.058156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:40.058497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:40.058828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:40.060021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:40.089809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:40.091381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 131/262] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:03:40 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:03:40.096617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:40.106178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5758-8136-4f52-bd99-ff15e7dc6909 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:40.110350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:40.110978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:40.111320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:40.111657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:40.119747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:40.151212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:40.160342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 132/263] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:40.166034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:40.176264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51417d4-35ce-46fd-98fe-065660d45a71 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:40.180497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:40.181354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:40.181692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:40.182076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:40.183261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:40.212402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdcaae-0acd-4523-bcab-2cf74b46f5bd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:40.214218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 132/264] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:40 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:40.219783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:40.228476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790dc524-7e26-4234-9c08-69690ba84037 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:40.233170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:40.233819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:40.234174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:40.234510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:40.235384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=452435bde81148b5b2befd5c252b2cec, user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:40.235752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:40.264444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1b32d-1c47-48f5-978f-6e70a80e9175 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:40.270419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 133/265] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:03:40 2021] GET /identity/v3/role_assignments?user.id=0b2a3a0c07804d7d84d3e31d65f4f6bb&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:42.275797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae620c-c4a2-41c7-9778-dc67e2ef176b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:42.276285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae620c-c4a2-41c7-9778-dc67e2ef176b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:42.276406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae620c-c4a2-41c7-9778-dc67e2ef176b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:42.278204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 133/266] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:42.283808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:42.284162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:42.284585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:42.308814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:42.310040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:42.317863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 134/267] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:42.339863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:42.340200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:42.340532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:42.363448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:42.364633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:42.371547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 134/268] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:42.377364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:42.386839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c6cd7-68ec-40bb-966f-eccdc14b6fd9 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:42.391641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:42.392439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:42.392780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:42.393112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:42.394316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:42.422701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d322a-34da-45ab-9f71-7fb3187f6662 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:42.424257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:03:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:42.429454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:42.439219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b8a7d-433f-4816-b1a2-f8caf48a4f6d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:42.443353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:42.444002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:42.444338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:42.444670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] PATH_INFO: `/v3/groups` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:42.445386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:42.472544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:03:42.472544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:03:42.472544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:03:42.473880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6a3c8-d6ab-4a98-a15c-43704dd08f27 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:42.512086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 135/270] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Aug 21 12:03:42 2021] POST /identity/v3/groups => generated 229 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:03:44.487463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde518a9-4364-464d-b2e6-3219abbd25af None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:44.487990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde518a9-4364-464d-b2e6-3219abbd25af None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:44.488126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde518a9-4364-464d-b2e6-3219abbd25af None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:44.489981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 136/271] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:44.495868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:44.496220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:44.496558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:44.520966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:44.522227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:44.529201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 136/272] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:44.550867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:44.551211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:44.551544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:44.575132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:44.576933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:44.583880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 137/273] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:44.589164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:44.598581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6aa8d-a66a-40be-b51b-ee7fb5f86cd0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:44.602744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:44.603544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:44.603884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:44.604216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:44.605376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:44.633756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec013f3-5f38-4a45-a3a1-fcb66990fa07 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:44.635317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 137/274] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:03:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:44.641054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:44.649924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b9339-fc72-44c7-a09a-cb68278df5e7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:44.654069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:44.654716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:44.655057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:44.655390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] PATH_INFO: `/v3/groups` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:44.656106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:44.683644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:03:44.683644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:03:44.683644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:03:44.684959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8683aab-1b57-40e7-baa3-5e2c60b2d940 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:44.757480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 138/275] 10.222.0.18 () {60 vars in 1146 bytes} [Sat Aug 21 12:03:44 2021] POST /identity/v3/groups => generated 226 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:03:46.726961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156dc8-45f2-4b0d-a843-b7494dea320a None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.729578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156dc8-45f2-4b0d-a843-b7494dea320a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.729578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156dc8-45f2-4b0d-a843-b7494dea320a None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.729578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 138/276] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:46.735260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.735611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.735946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.759615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:46.760818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:46.768511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 139/277] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:46.790729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.791106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.791444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.815495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:46.816696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:46.823840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:46.829754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:46.839310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96810e6-6057-4d9c-b58f-4d2e9df35510 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:46.843442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:46.844244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.844581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.844910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.856468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:46.863749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:46.864912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:46.870935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:46.880347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8f09b-5aad-4c55-84ee-88c4a84998d4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:46.884528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:46.885183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.885524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.885886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.886682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] RBAC: Adding query filter params (name=member) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:46.887033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:46.915364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:46.924713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 140/280] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:46.929916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:46.940564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729195e9-491b-4489-bac0-0d73eba68b51 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:46.944615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:46.945225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:46.945558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:46.945916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:46.953874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:46.981950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:46.991467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 141/281] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:46.997329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:47.007580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c9fad-07fb-45d9-8f4d-330695e2e9bc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:47.011716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:47.012573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:47.012908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:47.013236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:47.014463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:47.042717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:47.044344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 141/282] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:46 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:47.050218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:47.059020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298e26-dd10-4b30-8153-b3a096cbaa79 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:47.064148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:47.065006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:47.065346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:47.065681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:47.070631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:47.102244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:03:47.102244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:03:47.102244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:03:47.103582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe0336-fec0-45d2-8d06-18a014e296bb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:47.105218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 142/283] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:47 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:47.111830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:47.121637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1ad2-a27a-4a40-b824-6b2f68d5da25 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:47.126527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:47.127170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:47.127503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:47.127828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:47.128707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=1597b9d90cb1469eba0dcced76f27109) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:47.129061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:47.156947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd902c5-417c-4a21-93d7-a156cca1ea15 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:47.162564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 142/284] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:03:47 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:49.113569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790388-c81f-42f2-8fd4-8ccd8793bd9f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.114132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790388-c81f-42f2-8fd4-8ccd8793bd9f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.114282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b790388-c81f-42f2-8fd4-8ccd8793bd9f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.116132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 143/285] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:49.121634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.122015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.122352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.146030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:49.147228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:49.154807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 143/286] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:49.175830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.176176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.176512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.199662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:49.200842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:49.208311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 144/287] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:49.213538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:49.223749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab41d2-814b-4167-95b5-f0220676f068 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:49.227915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:49.228708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.229047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.229380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.241125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:49.248561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:49.249670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 144/288] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:49.255638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:49.264920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a16fd-351b-449f-b58e-29001b8f866a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:49.269064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:49.269706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.270075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.270412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.271204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:49.271560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:49.299967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:49.308738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:49 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:49.314261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:49.324195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388350a9-e875-4cd0-bd6c-46d019c96174 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:49.328894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:49.329716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.330079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.330408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.331553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:49.359248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:03:49.359248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:03:49.359248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:03:49.360557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:49.362126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:49 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:49.367294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:49.376658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623758d-1974-42ca-8984-36ca89a2af36 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:49.380790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:49.381634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.382008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.382345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.383524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:49.412797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd42bca-8a33-4a02-ae45-f3e1d9c335cf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:49.414506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:49 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:49.419546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:49.428887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f91a2f-7d3e-4daf-a34b-6dfbc139a1c1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:49.432957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:49.433830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:49.434163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:49.434492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109/groups/ba183b74ea024644bb72f4540f5f6392/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:49.436361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597b9d90cb1469eba0dcced76f27109, group_id=ba183b74ea024644bb72f4540f5f6392, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:49.465563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570415cb-1842-4c19-a196-8c6af3b4a84f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:49.501169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1454 bytes} [Sat Aug 21 12:03:49 2021] PUT /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109/groups/ba183b74ea024644bb72f4540f5f6392/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:51.478834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7f0e-a814-4e4d-8fd8-aa7c4989467f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.479361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7f0e-a814-4e4d-8fd8-aa7c4989467f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.479493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac7f0e-a814-4e4d-8fd8-aa7c4989467f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.481332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 147/293] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:51.487355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.487699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.488031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.512182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:51.513370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:51.578524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 147/294] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:51.600576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.600925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.601261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.625238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:51.626451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:51.633326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 148/295] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:51.638579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.647886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6b49-af27-4a97-8643-8c8e020ae18e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.651989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.652783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.653120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.653447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.665046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:51.672818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:03:51.673994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 148/296] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:51.680084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.689933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df442295-c4ce-4217-96ff-08c522908e61 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.694110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.694765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.695107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.695441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.696238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:51.696590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:51.724462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:51.734012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 149/297] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:51.739481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.750269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eafd53-2f41-41ca-9e95-bcebf425ff6c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.754593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.755224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.757640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.757640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.764208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:51.793249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:51.802876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 149/298] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:51.808525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.818423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52523f8-5e97-4b81-8a6e-1f0d158ae781 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.822648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.823508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.823848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.824183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.825377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:51.854389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:51.856111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 150/299] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:51.861967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.870734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea1680-dcfc-4c09-b7f9-36b946f25336 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.874886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.875731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.876065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.876392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.877525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:51.906065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d066792b-5485-49a7-8c2c-97c845efd3b3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:51.907598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 150/300] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:51.913041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:51.923212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95fdba-4d4f-46f1-a048-a4f26f678a7f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:51.927358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:51.927991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:51.928328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:51.928659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:51.929532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=1597b9d90cb1469eba0dcced76f27109) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:51.929919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:51.958016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738cb94-d846-4f99-863e-c230eacd1ead admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:51.963937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 151/301] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:03:51 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 611 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:53.916410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c996a-28a0-437e-be23-79e9f79ce31b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:53.916926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c996a-28a0-437e-be23-79e9f79ce31b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:53.917030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c996a-28a0-437e-be23-79e9f79ce31b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:53.918893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 151/302] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:53.924354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:53.924709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:53.925049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:53.948432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:53.949630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:53.957558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 152/303] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:53.980320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:53.980664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:53.981000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.005462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:54.006725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:54.014305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 152/304] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:54.019780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.029247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c70a3e-b0c7-4a08-a194-bba3895e5840 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.033995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.034809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.035148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.035477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.047001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:54.054675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:54.055854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 153/305] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:54.062506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.071395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02593bba-bf01-4dfa-9750-a53de13f15d8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.075594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.076807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.077147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.077482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.078309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:54.078663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:54.106758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:54.115454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 153/306] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:54.120757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.131067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3ecf6-8e0b-47f0-9ccf-fce9ce777053 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.135206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.135814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.136151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.136482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.145059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:54.172824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:54.181469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 154/307] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:54.187564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.196956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fbb4c-1202-4d4f-b23d-e7453bc31d15 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.201649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.202553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.202892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.203222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.204404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:54.232878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:54.234548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 154/308] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:54.239675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.248872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe87f-10e2-4a3a-93b3-5d564f8e1e7b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.253058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.253932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.254273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.254605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.255772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:54.284220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91217040-76ca-4119-859a-b36d64494546 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:54.285762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 155/309] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:54.290975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:54.300468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdeb8a-20ef-47aa-8fa3-8e4abe075972 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:54.304633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:54.305249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:54.305621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:54.305956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:54.306818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=1597b9d90cb1469eba0dcced76f27109) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:54.307178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:54.336516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65133d-6558-4336-8455-30791ae0923c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:54.342089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 155/310] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:03:54 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:56.297606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d38cc-53ab-4252-a1a4-4425e1789605 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.298124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d38cc-53ab-4252-a1a4-4425e1789605 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.298228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d38cc-53ab-4252-a1a4-4425e1789605 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.300065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 156/311] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:56.305541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.305916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.306253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.329522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:56.330743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:56.337646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 156/312] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:56.359580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.359921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.360255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.383232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:56.384465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:56.391404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 157/313] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:56.396560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:56.406441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde50bd-f121-4346-923a-8708bc218767 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:56.410552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:56.411358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.411695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.412020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.424233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:56.431886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:56.433032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:56.439349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:56.448231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91375e65-810d-48f9-9f74-d0bcc5a0be95 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:56.452420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:56.453070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.453414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.454313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.455112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:56.455468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:56.484280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:56.492985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:56.498491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:56.508314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08eb79e-a18e-4e44-9e97-1da91396907a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:56.512587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:56.513406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.513739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.514099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.515249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:56.544148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:56.546301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 158/316] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:56 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:56.551505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:56.560933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2d7e-f572-48ff-8541-31020e65b058 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:56.565352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:56.566227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.566573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.566909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.568097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:56.596725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757390c-9bfd-4fc3-9bbc-6af17ab5851f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:56.598438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:56 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:56.603510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:56.613381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a1c4c-86c1-47bd-acc9-85b539150c9b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:56.617464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:56.618339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:56.618674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:56.619005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109/groups/ba183b74ea024644bb72f4540f5f6392/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:56.621117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1597b9d90cb1469eba0dcced76f27109, group_id=ba183b74ea024644bb72f4540f5f6392, role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:56.650227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b87b9-d78e-493b-99f7-7eaf04785afb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:56.688996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 159/318] 10.222.0.18 () {58 vars in 1454 bytes} [Sat Aug 21 12:03:56 2021] PUT /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109/groups/ba183b74ea024644bb72f4540f5f6392/roles/8d3ffd13c75a4e7c952e828db384215e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:03:58.654103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb19d4-9e92-4205-8641-3c79e3986903 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.654645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb19d4-9e92-4205-8641-3c79e3986903 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.654734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb19d4-9e92-4205-8641-3c79e3986903 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.656559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 160/319] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:03:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:03:58.661982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.662336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.662679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.686466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:58.687937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:58.756154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 160/320] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:58.779120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.779461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.779794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.802788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:03:58.803982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:03:58.811333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 161/321] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:03:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:03:58.816820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:58.826973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43ac7-5cde-405d-8ee6-1740bebf3b39 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:58.831153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:58.831971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.832309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.832643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.844414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:03:58.852158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:03:58.853323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 161/322] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:03:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:03:58.859437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:58.868283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980385-18e7-48fb-9873-90a993a4e357 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:58.872395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:58.873537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.873906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.874240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.875026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:58.875375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:58.903632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:58.912246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 162/323] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:03:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:58.917453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:58.927970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc77464-815d-40d3-8f50-14468779b863 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:58.932172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:58.932792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:58.933132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:58.933464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:58.942463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:58.970999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:58.980101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 162/324] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:03:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:03:58.986387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:58.996160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2c67-345e-4f18-a7c5-28f8ab0f4f48 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:59.000965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:59.001878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:59.002228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:59.002565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:59.003784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:59.033998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:59.035717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 163/325] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:03:58 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:59.041480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:59.051218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b882d-d644-4f97-a47b-1c3d43a8878e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:59.055403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:59.056263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:59.056601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:59.056928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:59.058110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:59.087026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2cd9c0-c69b-469c-96bd-ab696c8d261e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:59.088571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 163/326] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:03:59 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:03:59.094188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:03:59.103914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff2e3-59fe-4457-bf02-7ef24e3d73a0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:03:59.108613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:03:59.109253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:03:59.109593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:03:59.109957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:03:59.110836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=1597b9d90cb1469eba0dcced76f27109) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:03:59.111202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:03:59.139790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4dd9d-784c-4b0f-bd16-512c3d87a285 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:03:59.145775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:03:59 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=1597b9d90cb1469eba0dcced76f27109&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:01.113197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ab22-4469-41a8-a8bb-caadbb834867 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.113678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ab22-4469-41a8-a8bb-caadbb834867 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.113885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099ab22-4469-41a8-a8bb-caadbb834867 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.115724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 164/328] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:01.121149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.121501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.121859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.145557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:01.146790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:01.154388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 165/329] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:01.176435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.176782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.177120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.200411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:01.202160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:01.209047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 165/330] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:01.214327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.224354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4b31b-7346-419f-ad48-ad4e4fd7b725 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.228487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.229285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.229654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.230011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.241531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:01.248820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:04:01.249972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:01.255816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.265126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9049c-3ee8-483e-9e54-c7e84e908217 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.269263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.269935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.270274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.270608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.271391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] RBAC: Adding query filter params (name=member) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:01.271741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:01.300223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:01.308975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:01.314632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.324441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517deee-b5e4-43b7-8ff4-42903f59d074 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.329021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.329642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.330006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.330336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.338378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:01.366858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:01.375700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 167/333] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:01.381331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.391482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc5123-e46c-4f94-98fd-38081dc6beda admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.395691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.396556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.396899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.397233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.398458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:01.427489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:01.429117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:01.434261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.443035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fa923-67f0-4f60-951d-093bd4096335 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.449124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.450014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.450357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.451190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.452370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:01.481875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe750727-f492-4290-9dbc-b9f15748ef50 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:01.483457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 168/335] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:01.488873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:01.498795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff88c-cca4-40e4-b708-16bd02877836 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:01.502961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:01.503540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:01.503875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:01.504201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:01.505061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=452435bde81148b5b2befd5c252b2cec) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:01.505416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:01.534339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9ff7-92be-48b4-98d3-05dc3126cf9a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:01.539770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 168/336] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:01 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:03.498445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8a8a-b763-4f3f-b9cf-5303f09e50b9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.498953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8a8a-b763-4f3f-b9cf-5303f09e50b9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.499075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc8a8a-b763-4f3f-b9cf-5303f09e50b9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.500960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 169/337] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:03.506507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.506853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.507190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.530753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:03.532614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:03.539559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 169/338] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:03.560732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.561079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.561415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.586450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:03.587637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:03.595225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 170/339] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:03.600754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:03.610315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14df4aa-46c5-4a1f-a664-1aa94312bc6f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:03.614381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:03.615177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.615511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.615839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.627426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:03.634765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:04:03.635996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:03.642309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:03.651115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba0f82-7704-4aef-ab0e-9ba2e19e5b69 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:03.655247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:03.655936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.656775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.657108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.657925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:03.658277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:03.686106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:03.695171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 171/341] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:04:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:03.700379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:03.710871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cbff50-5e93-45ce-8d39-e85f50a7e898 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:03.714998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:03.715827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.716163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.716492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.717644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:03.746314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:03.747847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:03 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:03.753582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:03.762959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52a13e-8159-4cb0-919d-b8d81206cfaa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:03.767704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:03.768553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.768894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.769231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.770457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:03.798602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a277a-41c5-406d-8f51-12f77677469b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:03.800214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 172/343] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:03 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:03.805386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:03.815584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee56521-925a-4f7c-b7e9-f5829ba97322 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:03.819746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:03.820604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:03.820941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:03.821272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec/groups/ba183b74ea024644bb72f4540f5f6392/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:03.823238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452435bde81148b5b2befd5c252b2cec, group_id=ba183b74ea024644bb72f4540f5f6392, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:03.852641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e06865-b11b-4816-a112-e634b8a43206 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:03.922780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 172/344] 10.222.0.18 () {58 vars in 1454 bytes} [Sat Aug 21 12:04:03 2021] PUT /identity/v3/projects/452435bde81148b5b2befd5c252b2cec/groups/ba183b74ea024644bb72f4540f5f6392/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:04:05.870250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e1a-79d4-4a05-9941-c8d1c193cc22 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:05.870765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e1a-79d4-4a05-9941-c8d1c193cc22 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:05.870890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb3e1a-79d4-4a05-9941-c8d1c193cc22 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:05.872706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 173/345] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:05.878268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:05.878613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:05.878945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:05.902870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:05.904074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:05.971793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 173/346] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:05.994115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:05.994460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:05.994794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.018917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:06.020108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:06.026962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 174/347] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:06.032453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.041905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0d740-3030-4909-a58b-a28addad5bec None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.046040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.046902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.047240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.047569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.059268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:06.067375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 12:04:06.068528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 174/348] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:06.074492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.083775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314af24-a712-457d-a7f8-79050914eac9 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.088157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.088815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.089154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.089484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.090593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:06.090942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:06.118593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:06.128129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:06.133196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.143659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250868c7-d69f-44a6-94aa-d1863496f323 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.147852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.148470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.148809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.149136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.157249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:06.185166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:06.194784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 175/350] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:06.200160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.210272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8463e8-e56c-4803-b6aa-2e053a0c7bc3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.214457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.215301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.215642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.215976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.217161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:06.245346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:06.247076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 176/351] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:06.252629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.261287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907f2c-b289-4652-a3b1-33919d7d1f98 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.266043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.266881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.267217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.267548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.268699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:06.296923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a88d6-a2cc-40a4-941b-2673cdea84d4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:06.298472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 176/352] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:06.303866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:06.314215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f545-b83a-4974-8976-360fb6a8ba65 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:06.318334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:06.318954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:06.319293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:06.319668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:06.320537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=5fc637628e7f40bfa94e77aac032c126, scope.project.id=452435bde81148b5b2befd5c252b2cec) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:06.320899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:06.349427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07321e20-1634-4bdc-8b9c-d00237c02229 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:06.355442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 177/353] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:06 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=5fc637628e7f40bfa94e77aac032c126 => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:08.336025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852adf-ade9-48ea-a85d-4e50c17bf5d8 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.336564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852adf-ade9-48ea-a85d-4e50c17bf5d8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.336564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce852adf-ade9-48ea-a85d-4e50c17bf5d8 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.338442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 177/354] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:08.344408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.344758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.345094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.368937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:08.370156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:08.377068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 178/355] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:08.398624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb392-307d-4262-b048-2251dc765371 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.398967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb392-307d-4262-b048-2251dc765371 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.399300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb392-307d-4262-b048-2251dc765371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.423227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-720eb392-307d-4262-b048-2251dc765371 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:08.424398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-720eb392-307d-4262-b048-2251dc765371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:08.431280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 178/356] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:08.436704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.446049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4905c-60ac-4e44-9c53-7cc40243dade None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.450159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.450966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.451303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.451640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.463257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:08.471493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:04:08.472737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 179/357] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:08.478715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb392-307d-4262-b048-2251dc765371 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.488229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb392-307d-4262-b048-2251dc765371 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.492341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.492990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.501991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.502376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.503195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:08.503553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:08.532296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:08.541097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 179/358] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:08.547026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.557029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea6ca2-9e83-4052-be47-d410743d39a4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.561178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.562098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.562433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.562762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.570762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:08.599799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:08.608440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 180/359] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:08.613690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.623044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f50e0-db1c-4be7-8f3e-30621ab0f701 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.627137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.627980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.628316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.628642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.629819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:08.659298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:08.660889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 180/360] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:08.666059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.674765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1099-b311-43bb-83d5-6a599d1b3e33 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.678966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.679807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.680148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.680481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.681643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:08.710351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d937c8-1ae4-4cf3-ac23-8f51f39015b5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:08.711980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 181/361] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:08.717101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:08.726901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd757611-aca3-4c30-bdb0-86f2c8110f21 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:08.731018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:08.731627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:08.731967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:08.732296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:08.733142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=452435bde81148b5b2befd5c252b2cec) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:08.733495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:08.761323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28623-8d39-4fc9-bcf7-63f5d72a3104 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:08.767644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 181/362] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:08 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:10.705562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594397-cfa1-4851-baab-3581a01cb0a4 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.706148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594397-cfa1-4851-baab-3581a01cb0a4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.706262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07594397-cfa1-4851-baab-3581a01cb0a4 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.708086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 182/363] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:10.713471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.713834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.714169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.737274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:10.738496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:10.745350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 182/364] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:10.767780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.768134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.768476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.791633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:10.792839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:10.799898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 183/365] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:10.805209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:10.815329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40058e-4385-49e5-9475-561ca52dfca9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:10.819425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:10.820227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.820563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.820890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.833056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:10.840759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:04:10.841931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 183/366] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:04:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:10.847976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:10.856849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d724e-f34c-44e3-90a2-9bae96d9c586 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:10.861572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:10.862283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.862623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.862959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.863757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:10.864115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:10.892615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:10.901323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 184/367] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:10.906553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:10.916449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f963521-bcf9-4562-b8d8-8a25ddec4ec7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:10.920573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:10.921912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.922244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.922569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.923713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:10.952525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:10.954083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 184/368] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:10 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:10.960014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:10.970061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af9808-d438-4b5d-8a8e-b81b0afc4841 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:10.974277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:10.975148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:10.975489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:10.975824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:10.977027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:11.006805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de8cd7-59ff-4ccb-bd58-fdeb9b5a4919 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:11.008481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:10 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:11.014322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:11.024071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d00ff-8342-4702-b279-5c4d6ec04b9a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:11.028172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:11.029055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:11.029390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:11.029719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec/groups/ba183b74ea024644bb72f4540f5f6392/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:11.031862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=452435bde81148b5b2befd5c252b2cec, group_id=ba183b74ea024644bb72f4540f5f6392, role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:11.061196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6355ac-2d2b-4f93-9ee8-bec06f921c6e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:11.105613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1454 bytes} [Sat Aug 21 12:04:11 2021] PUT /identity/v3/projects/452435bde81148b5b2befd5c252b2cec/groups/ba183b74ea024644bb72f4540f5f6392/roles/8d3ffd13c75a4e7c952e828db384215e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:04:13.065303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72266-a391-4874-8459-c70229fa1d63 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.065762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72266-a391-4874-8459-c70229fa1d63 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.065994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72266-a391-4874-8459-c70229fa1d63 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.067842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 186/371] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:13.073141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.073487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.073845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.098019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:13.099209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:13.163891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 186/372] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:13.185668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.186058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.186642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.210180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:13.211367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:13.218922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:13.224179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.233478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6d7f-88f0-472b-999c-704219dd696c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.237587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.238443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.238782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.239113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.250730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:13.258334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:04:13.259478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 187/374] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:13.266071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.274896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6638f3-b120-4d4b-b23f-6c8017135fbf None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.279069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.279713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.280052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.280385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.281779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:13.282173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:13.309919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:13.318802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 188/375] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:13.324141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.334663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c22f1-4185-4253-bf84-cd8663aef143 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.338786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.339404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.339738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.340067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.348740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:13.376773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:13.385528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 188/376] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:13.391319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.400604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e0f5f-721d-4e4d-a671-65a07ed3023b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.404681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.405521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.406474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.406803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.407996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:13.436020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:13.437900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 189/377] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:13.443262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.451763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196880-bb2d-4d5e-96bb-2583442c24e3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.456549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.457388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.457718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.458080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] PATH_INFO: `/v3/groups/ba183b74ea024644bb72f4540f5f6392` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.459228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] RBAC: Authorizing `identity:get_group(group_id=ba183b74ea024644bb72f4540f5f6392)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:13.487792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5334691-ef0b-41ce-b82d-d1be0bbfbf7a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:13.489343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 189/378] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/groups/ba183b74ea024644bb72f4540f5f6392 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:13.495078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:13.505156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11246c64-a90e-4d39-8df4-c326ea3e1bfb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:13.509216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:13.509866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:13.510204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:13.510531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:13.511401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] RBAC: Adding query filter params (group.id=ba183b74ea024644bb72f4540f5f6392, role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=452435bde81148b5b2befd5c252b2cec) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:13.511760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:13.540166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1364e0-f3a5-47b1-97b3-9cb48196d964 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:13.546877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 190/379] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:13 2021] GET /identity/v3/role_assignments?group.id=ba183b74ea024644bb72f4540f5f6392&scope.project.id=452435bde81148b5b2befd5c252b2cec&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:15.514330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf614-ea5b-4b12-b698-4dc40485199f None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.514849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf614-ea5b-4b12-b698-4dc40485199f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.514997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcf614-ea5b-4b12-b698-4dc40485199f None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.517318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 190/380] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:15.522678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.523025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.523361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.547060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:15.548239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:15.555173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 191/381] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:15.577183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.577530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.577893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.602061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:15.603246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:15.610270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 191/382] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:15.615509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.624914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a5e18-771b-4cd6-bf88-da90aaee2240 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.629015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.629836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.630176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.630511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.642808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:15.650112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:15.651359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 192/383] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:15.657595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.666410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f89833-bbdf-4edf-9177-5005043bba9d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.670511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.671151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.671488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.671846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.672635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:15.672984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:15.701564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:15.711000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 192/384] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:15.716291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.726571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9582c-6643-424b-8773-b8a8f46aae40 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.730836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.731464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.731812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.732149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.740343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:15.769638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:15.778471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 193/385] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:15.784021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.793575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140161e-786f-4ac9-b8cb-5dd0fdf92607 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.797706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.798592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.798929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.799265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.800443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ce60da1aac441c9b29c109feb2ce1b7)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:15.829884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:15.831528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 193/386] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7 => generated 344 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:15.836936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.845900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c90297-83b6-4a40-bca4-c5f2940e4c8f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.850104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.850963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.851305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.851642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] PATH_INFO: `/v3/groups/8947d76615f2498093e202bb0eea12dd` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.856445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] RBAC: Authorizing `identity:get_group(group_id=8947d76615f2498093e202bb0eea12dd)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:15.885109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726f26-70a2-4436-bef4-c46cd5a20af1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:15.886718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 194/387] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/groups/8947d76615f2498093e202bb0eea12dd => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:15.892812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:15.902441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306732bd-d248-40a6-8c36-14f1d8f21fa2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:15.906629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:15.907264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:15.907603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:15.907936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:15.908801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] RBAC: Adding query filter params (group.id=8947d76615f2498093e202bb0eea12dd, role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:15.909161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:15.938083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dfc5a-d890-40af-bc28-adc170713b1b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:15.943625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 194/388] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:15 2021] GET /identity/v3/role_assignments?group.id=8947d76615f2498093e202bb0eea12dd&scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7&role.id=90f6703d946e4169827377b5a8ffae62 => generated 260 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:17.890742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd60-d8b0-4f81-8873-1f08b00cd99a None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:17.891258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd60-d8b0-4f81-8873-1f08b00cd99a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:17.891377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ccd60-d8b0-4f81-8873-1f08b00cd99a None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:17.893206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 195/389] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:17.898801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:17.899152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:17.899492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:17.924218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:17.925437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:17.932633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 195/390] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:17.954435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:17.954779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:17.955113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:17.978874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:17.980067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:17.987687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 196/391] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:17.993392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:18.003199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a4686-7434-4b61-84b4-897fd505c29b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:18.007372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:18.008178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:18.008516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:18.008849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:18.024561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:18.031824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:18.033507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 196/392] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:18.039941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:18.050389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c74cc-24d1-49d0-859c-2be871156e40 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:18.054776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:18.055448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:18.055788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:18.056123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:18.056924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:18.057272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:18.085694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:18.094881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 197/393] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:18.101435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:18.112275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f55ba6-925f-4415-8ade-3fdce8b4ef70 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:18.116553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:18.117406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:18.117739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:18.118089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] PATH_INFO: `/v3/groups/8947d76615f2498093e202bb0eea12dd` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:18.119247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] RBAC: Authorizing `identity:get_group(group_id=8947d76615f2498093e202bb0eea12dd)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:18.147632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:18.149115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 197/394] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:18 2021] GET /identity/v3/groups/8947d76615f2498093e202bb0eea12dd => generated 229 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:18.154464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:18.164576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cdb82-5890-4f10-9cc8-e9d23415e523 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:18.168770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:18.169621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:18.169987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:18.170322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:18.171508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ce60da1aac441c9b29c109feb2ce1b7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:18.200548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb155a-05fd-48b9-b566-39415cee7ec3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:18.202274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 198/395] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:18 2021] GET /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7 => generated 344 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:18.207700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:18.217327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141ac90-45e9-43df-92d0-d96026edd829 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:18.222038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:18.222905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:18.223236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:18.223564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7/groups/8947d76615f2498093e202bb0eea12dd/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:18.225468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce60da1aac441c9b29c109feb2ce1b7, group_id=8947d76615f2498093e202bb0eea12dd, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:18.255067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0c191-8c6e-4703-b871-21ea100a97a9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:18.311559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 198/396] 10.222.0.18 () {58 vars in 1454 bytes} [Sat Aug 21 12:04:18 2021] PUT /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7/groups/8947d76615f2498093e202bb0eea12dd/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:04:20.290810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf68df-4ccf-426e-a2a0-31417219160a None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.291298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf68df-4ccf-426e-a2a0-31417219160a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.291398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf68df-4ccf-426e-a2a0-31417219160a None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.293223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 199/397] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:20.299369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.299714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.300047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.324205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:20.325394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:20.390145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:20.412385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.412737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.413079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.437019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:20.438240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:20.445306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 200/399] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:20.450810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.460316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f1847-f0a6-4133-b642-1e5d3f786a70 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.464535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.465363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.465708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.466078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.478889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:20.486964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:20.488194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 200/400] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:20.494900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.504159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37505-464a-4c4b-b357-516bc0ee3c02 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.508507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.509179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.509522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.509886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.510696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:20.511051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:20.539494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:20.549050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 201/401] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:20.554469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.564859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da245c8-456a-4b88-b5f3-2e83a3e6983b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.568974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.569605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.569971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.570302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.578551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:20.607632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:20.616604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 201/402] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:20.621910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.631373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c929c-0b2d-496b-b523-c6d7d9dc8de3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.635550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.636398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.636741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.637077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.638297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] RBAC: Authorizing `identity:get_project(project_id=8ce60da1aac441c9b29c109feb2ce1b7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:20.667204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:20.668826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 202/403] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7 => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:20.673852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.682496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb40818-0d54-41da-af82-718971738ba9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.686902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.687726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.688061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.688387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] PATH_INFO: `/v3/groups/8947d76615f2498093e202bb0eea12dd` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.689525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] RBAC: Authorizing `identity:get_group(group_id=8947d76615f2498093e202bb0eea12dd)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:20.717821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e2be2-285a-430c-83f3-8d47209a4260 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:20.719425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 202/404] 10.222.0.18 () {56 vars in 1192 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/groups/8947d76615f2498093e202bb0eea12dd => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:20.725161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:20.734576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a740cb-c56c-45ca-bd82-8db1dddd806f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:20.738806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:20.739419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:20.739761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:20.740097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:20.740957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] RBAC: Adding query filter params (group.id=8947d76615f2498093e202bb0eea12dd, role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:20.741317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:20.770822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb24a89-049c-45de-a6ec-dc5ed122c56f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:20.777117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 203/405] 10.222.0.18 () {56 vars in 1388 bytes} [Sat Aug 21 12:04:20 2021] GET /identity/v3/role_assignments?group.id=8947d76615f2498093e202bb0eea12dd&scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7&role.id=90f6703d946e4169827377b5a8ffae62 => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:22.780506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122dfa-4d65-4983-a6a5-ad114d2fccda None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:22.781023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122dfa-4d65-4983-a6a5-ad114d2fccda None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:22.781127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47122dfa-4d65-4983-a6a5-ad114d2fccda None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:22.782977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 203/406] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:22.788560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:22.788903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:22.789238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:22.813228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:22.815173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:22.822185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:22.844570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:22.844918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:22.845256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:22.869040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:22.870271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:22.877839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 204/408] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:22.883127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:22.892586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da1c4c-f722-40c8-a1d9-5240acc32f34 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:22.896718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:22.897511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:22.897877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:22.898216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:22.910199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:22.939736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:22.957621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:22.958781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 205/409] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:22.964935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:22.974150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61e09-383e-4c8f-bb37-c392a6d00299 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:22.978411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:22.979074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:22.979417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:22.979753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:22.980527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:22.980880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:23.009460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:23.009460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:23.009460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:23.010484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2fd80f-8d08-4229-8700-e82b14140024 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:23.024042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 205/410] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:23.029660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:23.039399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b272b-a5f8-4729-be7e-1854e14815eb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:23.043421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:23.044083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:23.044419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:23.044750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:23.045470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:23.075129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d6f21-62b4-41c0-b2f8-fd3860d6c02e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:23.242708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 206/411] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:04:23 2021] POST /identity/v3/users => generated 246 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:04:25.231639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a576-f3b9-4c91-8089-dacfbc6eeb20 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.232152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a576-f3b9-4c91-8089-dacfbc6eeb20 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.232254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955a576-f3b9-4c91-8089-dacfbc6eeb20 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.234135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 206/412] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:25.239581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.239927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.240254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.262911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:25.264047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:25.271440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 207/413] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:25.293418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.293763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.294140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.316813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:25.318016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:25.324908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:25.330479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.339639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362bd39-9f00-413d-a67b-d48afdfcce61 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.343732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.344521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.345483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.345876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.357455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:25.364759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:04:25.365920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:25.371835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.380776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61925-1ce6-47ef-aeb9-027407af0fa4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.385009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.385665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.386037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.386374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.387170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:25.387523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.417517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.426560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 208/416] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:25.432155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.443159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270965a-0229-4810-aeeb-54e5232a14b1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.447272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.448055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.448391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.448722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.460881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.488911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.508344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:25.509498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 209/417] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:25.515219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.525626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42e99-339a-4478-b142-9b432d1afc2f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.529862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.530525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.530866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.531203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.531980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:25.532336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.560247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.574144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 209/418] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:25.579884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.589380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc73e2-0b72-40f2-948d-2273c0b41dba admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.593480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.594280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.594616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.594945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.607997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.636590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.655978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:25.657101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 210/419] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:25.662663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.672262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2948-8130-47e2-9218-4fa7be00bd55 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.676398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.677057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.677397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.677731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.678658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:25.679016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.707587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:25.707587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:25.707587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:25.708867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.740526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 210/420] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:25.746457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.757563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478a175-defc-4c5e-8f61-0d395a99897a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.761705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.762378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.762716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.763051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.772672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.800883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.809662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 211/421] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:25.816497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.826391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e3e4-c1ef-4034-9a5a-44538d6b802d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.830874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.831685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.832027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.832364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.844588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.873267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.891856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:25.893011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 211/422] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:25.898691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.907686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748d62-1eaf-4b0a-8384-5367480fb020 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.911937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.912591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.912930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.913261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.914060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:25.914411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:25.943558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:25.955970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 212/423] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:25.961212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:25.971042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d60e98-4350-4c6f-b2b6-fd659e118440 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:25.975282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:25.976261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:25.976598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:25.976932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:25.986779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:26.015789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:26.030696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:26.031813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:26.038605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:26.049141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827c7e7-6c0e-4d3d-a04c-0c60f5618d52 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:26.053312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:26.054002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:26.054435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:26.054899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:26.056129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:26.056633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:26.087198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:26.087198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:26.087198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:26.088500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b48ac-88e6-4d50-843f-e72d71c962e4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:26.102127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:26.108077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:26.118398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fefa1-dead-4a08-a981-a205a41a57ad admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:26.122549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:26.123192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:26.123530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:26.123861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:26.124739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:26.125095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:26.153771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002d1c3-052c-4f99-9b0c-d633673bcee1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:26.159868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:04:26 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.112729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac38d5-f63a-48af-bdf6-16a5ee679c96 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.113259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac38d5-f63a-48af-bdf6-16a5ee679c96 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.113348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac38d5-f63a-48af-bdf6-16a5ee679c96 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.115240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 214/427] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:28.120577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.120925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.121260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.146912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:28.148113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:28.155108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 214/428] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:28.177170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.177510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.177867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.201137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:28.202349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:28.209270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 215/429] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:28.214559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.223923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cd6e2-cd0c-4ef4-8999-d78c7d09a566 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.228056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.228849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.229184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.229509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.241424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:28.248689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:04:28.249782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 215/430] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:28.256351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.265245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef7c1-b7e3-4fb2-96c7-87ddc8d816b0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.269375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.270048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.270389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.270720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.271511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:28.271860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.300171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.308759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 216/431] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.314932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.324936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00860743-0d84-4b1f-a69a-b2019f52ae0d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.329078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.329865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.330204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.330536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.342063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.370539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.389599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:28.390741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 216/432] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:28.396135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.405470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1a8b-0c29-4d8c-8d32-969f0b318f61 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.410108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.410742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.411077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.411403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.412156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:28.412502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.441022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.453975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 217/433] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.459139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.468602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2171-b28d-4fa5-a9bb-0d091744614b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.473220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.474019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.474359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.474691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.488436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.517171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.536522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:28.537650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 217/434] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:28.543034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.553088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5b79c-bda7-46c7-b796-af82f0dae69e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.557269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.557943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.558280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.558611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.559483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:28.559835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.587177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:28.587177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:28.587177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:28.588450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.619679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.624946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.634578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8fdff-afa0-42c0-a669-2ebc4870b6e2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.638728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.639504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.639840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.640169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.652561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.681642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.699934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:28.701067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 218/436] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:28.706393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.715859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437484-0ae6-48c7-972f-fecf97de245d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.720539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.721176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.721514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.721871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.722630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:28.722977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.751278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.763697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 219/437] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.769179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.778783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0184bc-a51b-4c64-be1e-de3a597a85ba admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.783439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.784218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.784556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.784887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.794038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.823171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.838299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:28.839430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 219/438] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:28.845467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.855050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76d3d6-fe67-49fd-8a7e-3bdd32712bc0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.859241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.859886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.860223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.860556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.861388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:28.861744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.889647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3b453-9875-44db-afb0-3c16ea2ce37f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:28.903579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 220/439] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:28.909748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:28.919279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f981ca-08d5-46b6-9cbd-0f633e3e2729 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:28.923400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:28.924272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:28.924606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:28.924935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:28.946143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=d950460ecfe846a7ab6f4933bd97454e, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:28.977005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcdcfe-02f4-48ad-9826-5e0e1d0ac13f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:29.042558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:04:28 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:04:30.987345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb229f-d566-4422-8263-a4da95087f88 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:30.987854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb229f-d566-4422-8263-a4da95087f88 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:30.988010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb229f-d566-4422-8263-a4da95087f88 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:30.990134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 221/441] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:30.995280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:30.995624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:30.995954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.020180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:31.021381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:31.086499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:31.108366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.108714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.109054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.134720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:31.135910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:31.142935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 222/443] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:31.148241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.157646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65739cd-d666-4e39-9821-51ec94eb446f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.161769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.162594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.162931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.163258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.175349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:31.182717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:04:31.183861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:31.190661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.199442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7d953-3637-43d7-a1b1-25618da110b8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.203561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.204236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.204573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.204902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.205688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.206065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.233846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.243021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 223/445] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:31.248250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.258931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff24fb9-c025-47ce-9083-a850f9167574 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.263109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.263881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.264218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.264548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.276171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.304960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.324490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:31.325636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 223/446] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:31.330937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.340389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc662d7f-86b2-4987-97ea-8b7d8620c139 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.344519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.345156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.345495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.345850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.346612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.346960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.375108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.388731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 224/447] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:04:31.393924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.403366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1d40a-3007-40db-acb5-6a0b1bee9898 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.408022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.408789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.409128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.409465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.425727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.454683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.474146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:31.475282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 224/448] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:31.480695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.490759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8c4be-283f-4b07-b949-ae09ed9a6e13 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.495355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.495957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.496297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.496630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.497508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.497888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.526799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.556674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 225/449] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:31.562416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.572431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6669fc-201b-4fa5-a89d-c8eeff588b46 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.576527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.577153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.577489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.577826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.586383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.614013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.622700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 225/450] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:31.628464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.637948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20340d51-7d8f-44c5-bf76-8712710482b0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.642615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.643393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.643732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.644065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.655923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.683811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.703569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:31.705283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:31.710619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.719347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14711013-9238-4aae-9d48-d051471f9389 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.723565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.724201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.724537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.724868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.725619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.726018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.753983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.767681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 226/452] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:31.772875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.782414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f1b75-a0b8-4ad3-b145-197f2094d1f7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.786577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.787341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.787677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.788011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.797019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.826453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.841041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:31.842188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:31.847499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.856923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1c4f6-0489-4bc0-9f86-82272139d69a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.861500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.862167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.862503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.862833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.863656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.864007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.891842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:31.891842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:31.891842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:31.893100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb4a19-b495-4dda-aaf7-89f52f740573 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.906363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:31.911914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:31.921389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9923a3-9f4d-450a-b2c8-7aabda40d4f2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:31.926060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:31.926685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:31.927023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:31.927354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:31.928223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:31.928580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:31.957369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b96dce-9d38-4ac7-898f-b6413889ec01 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:31.963413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:04:31 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:33.965271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e05a-ffbf-465e-9a3d-abe592f601ec None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:33.965829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e05a-ffbf-465e-9a3d-abe592f601ec None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:33.965960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e05a-ffbf-465e-9a3d-abe592f601ec None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:33.967846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:33.973882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:33.974240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:33.974579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:33.998693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:33.999860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:34.007183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:34.029499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.029868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.030203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.069304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:34.070547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:34.077467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 229/458] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:34.083439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.093044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f997338-32ac-4cfd-93b2-037fdfa8591a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.097973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.098779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.099120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.099454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.111143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:34.118440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:34.119604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 230/459] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:34.125393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.134277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5976e-a36d-430c-b34e-0001cd526391 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.138339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.138985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.139322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.139650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.140434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.140781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.169613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.178459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 230/460] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:34.183777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.194054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca9bdc-9fb7-46f3-a916-e23197c8974a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.198220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.198985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.199323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.199655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.211744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.240625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.259316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:34.260463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 231/461] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:34.265808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.275861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245a11-108d-4b58-9497-d2c8ba1343d6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.280006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.280653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.280999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.281335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.282738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.283088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.310831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.324110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 231/462] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:34.329773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.339355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489d1d8-b871-4b32-8cba-99433ed05706 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.343442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.344223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.345162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.345488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.358913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.387392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.408211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:34.409410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 232/463] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:34.415410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.425210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01fed7-d9c0-47c9-9e2a-338f88fd2850 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.429325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.430048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.430387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.430720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.431610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.431964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.461531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.491888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:34.497947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.508172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96c4f5-cb94-47b5-a241-f381c9f5d94d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.512336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.512975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.513315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.513644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.523126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.550908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.559688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 233/465] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:04:34.565872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.575343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf7c71-8c68-4d11-a2f3-4c536927e29e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.580070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.580857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.581196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.581527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.593348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.621292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.639526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:34.640657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 233/466] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:34.646644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.655449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ddacb-e6a4-4b66-99ff-01beb2ffd630 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.659642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.660280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.660617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.660950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.661707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.662085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.690525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.702993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 234/467] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:34.708756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.718205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e30d5-9a89-4a4b-9ef0-2a2ddc0cab78 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.722320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.723083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.723415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.723741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.732737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.761355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.776397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:34.777598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 234/468] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:34.782812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.792322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f18457-be3c-4303-9b90-aedd6f504749 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.796467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.797107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.797443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.798309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.799135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.799490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.828246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370d4e9-b300-4e60-b626-3eec9adb5f9c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.841681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 235/469] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:34.847090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:34.856469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bfc82-ce24-4b83-9b75-1c70137da506 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:34.861043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:34.861663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:34.862028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:34.862354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:34.863210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:34.863561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:34.891847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd08fa-394a-407b-a55d-c3f616eb84f7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:34.897299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 235/470] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:04:34 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:36.856695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622cf8e-fc0f-4287-83fc-a10dca023959 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:36.857214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622cf8e-fc0f-4287-83fc-a10dca023959 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:36.857318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622cf8e-fc0f-4287-83fc-a10dca023959 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:36.859193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 236/471] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:36.865179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:36.865531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:36.865896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:36.889228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:36.890470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:36.897448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 236/472] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:36.919285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:36.919627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:36.919960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:36.945593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:36.946804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:36.953632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 237/473] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:36.958980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:36.968425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7bc24-6197-4326-867f-d06238aeb224 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:36.973094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:36.973944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:36.974280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:36.974607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:36.986907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:36.994152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:36.995330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 237/474] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:37.001771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.010758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31803e-5ecb-4fb7-b776-9a2106f82467 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.014930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.015593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.015931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.016288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.017091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:37.017443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.045644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.055213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 238/475] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:37.060896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.071526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437fb4-b0e0-4763-b9a0-c3c31cd42728 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.075690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.076479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.076817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.077147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.089230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.117957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.136373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:37.137496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 238/476] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:37.143293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.152758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16197892-e28d-448c-bad7-6bd128581268 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.156975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.158164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.158503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.158836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.159600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:37.159953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.187675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.200658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 239/477] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:37.206581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.216121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e7c8-7cba-40d0-b364-c76b168e5e27 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.220850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.221621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.221985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.222318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.237817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.265971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.286108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:37.287260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 239/478] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:37.293008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.302947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ef90-8cc8-46de-a3a9-21a0b783d0b9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.307105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.307763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.308100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.308430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.309315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:37.309669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.338269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.368828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 240/479] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:37.374150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.383766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52ae5-91e1-4634-be88-0a623645509d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.387880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.388653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.388985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.389311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.402335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.430663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.449120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:37.450265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 240/480] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:37.456251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.465833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d4ba3-718f-4873-b2e3-970eabf8ad28 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.470024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.470671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.471013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.471350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.472119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:37.472470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.500539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.513506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 241/481] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:37.519354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.528766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a67fc-2d9f-4fc8-bee8-172d7daf8275 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.532893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.533654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.534016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.534347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.543322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.572136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.587265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:37.588395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 241/482] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:37.593724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.603386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9e48b-b637-49d4-9368-8604dffcb58a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.607513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.608158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.608500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.608833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.609664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:37.610067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.638581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc677f-a67c-456e-898a-93490cdcea88 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.652578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 242/483] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:37.658209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:37.667778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41986c0d-6c12-417c-901d-d69ad8931872 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:37.671923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:37.672798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:37.673140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:37.673468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:37.675396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=d950460ecfe846a7ab6f4933bd97454e, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:37.705598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c813039-c0fe-48f3-b65a-5a9fb2203067 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:37.768889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 242/484] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:04:37 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:04:39.700714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092196-8da0-4fc1-a30e-2eef83929acc None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.701279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092196-8da0-4fc1-a30e-2eef83929acc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.701393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52092196-8da0-4fc1-a30e-2eef83929acc None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.703240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 243/485] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:39.708770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.709122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.709458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.733355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:39.734583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:39.802022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 243/486] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:39.824348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.824698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.825034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.848360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:39.849569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:39.856594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 244/487] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:39.862499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:39.871914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4e425-b048-425c-b955-4c3934f65c80 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:39.876138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:39.876939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.877277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.877608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.889217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:04:39.896557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:04:39.897821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 244/488] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:04:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:39.903684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:39.913078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158a323-24e4-4add-8020-a98bfa13250e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:39.917287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:39.918006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.918351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.918688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.919486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:39.919843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:39.948516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:39.957420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 245/489] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:04:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:39.962582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:39.973143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b1857-523c-4bf5-9339-18d96573ba95 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:39.977271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:39.978106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:39.978444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:39.978796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:39.991004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.019235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.038399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:40.039547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:40.045300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.055717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1f02-f9ac-49a3-a0c7-aa55f32dbf5b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.059950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.060613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.061210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.061553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.062361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:40.062716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.090903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.104762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:40.109950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.119391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad9b6d-1e91-4080-8307-c127af3c3ec6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.123488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.124262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.124597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.124928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.137993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.167427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.186633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:04:40.187738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:40.193263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.202838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9a71-bb5d-400e-9f58-48eaeccd9240 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.207541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.208148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.208489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.208824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.209702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:40.210087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.238777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.269412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:40.274874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.285027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef3da9-1cdf-406a-b8fd-45a594884df0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.289119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.289745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.290128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.290455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.299285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.327460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.336689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 247/494] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:04:40.341997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.352005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769c6a-5f1b-4643-91f3-68eb02348552 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.356118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.356899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.357240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.357572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.369369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.397847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.416284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:04:40.417425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:40.422855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.431578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e15de-4b9c-4013-a8d9-cac3289728cf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.435712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.436603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.436936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.437263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.438548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:40.438894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.467207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.479469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:40.484652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.494686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903249e-883d-40c9-92f0-9059a45338d1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.498825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.499600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.499936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.500308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.509945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.538723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.553320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:04:40.554562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:40.559898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.570240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ba7f-3085-43a6-b65e-81bae208c160 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.574386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.575025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.575366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.575702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.576527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:40.576881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.605607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2479ccb-8f95-4e2a-8acc-2227b6137f29 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.619052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 249/498] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:40.624515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:40.634343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3e0c-ef9d-4fcb-b197-1fd997cb87cf admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:40.638451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:40.639070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:40.639402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:40.639728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:40.640588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:40.640940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:40.669932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa6be3-299d-40cd-b418-f15104e151c8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:40.676031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 250/499] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:04:40 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:42.657452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecefa-ba5c-4b92-a500-15acf169f431 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.657994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecefa-ba5c-4b92-a500-15acf169f431 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.658129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ecefa-ba5c-4b92-a500-15acf169f431 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.659957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 250/500] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:42.665474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.665842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.666181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.690362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:42.691549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:42.698496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 251/501] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:42.720539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.720889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.721226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.744756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:42.745987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:42.752972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 251/502] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:42.758178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:42.767553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883e27c-9f61-48d7-a31b-d02ddf37fb5d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:42.771645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:42.772450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.772786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.773114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.773821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:42.802007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:42.802007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:42.802007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:42.803010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:42.815786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 12:04:42.816927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1144 bytes} [Sat Aug 21 12:04:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:42.823206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:42.832228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b152c-93b3-4990-bd6b-42aa905b039a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:42.836409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:42.837064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.837399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.837735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.838546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:42.838893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:42.867196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:42.867196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:42.867196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:42.868190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e1d5-94b1-4c27-966b-3427b23449d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:42.872637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 252/504] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:42.878006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:42.887414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342a345-bacf-4ad3-a531-c10d7b1df49c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:42.891535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:42.892170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:42.892508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:42.892840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:42.893621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:42.894001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:42.921556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:42.921556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:42.921556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:42.923128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98c6d1-0d3a-4bfa-bd54-adbd628e5ae5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:42.927698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:42 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:44.891817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4342-3549-4a94-b760-507563c8115d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:44.892336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4342-3549-4a94-b760-507563c8115d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:44.892459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f4342-3549-4a94-b760-507563c8115d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:44.894348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 253/506] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:44.899647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:44.899994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:44.900330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:44.926589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:44.927775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:44.934673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 254/507] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:44.956457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d288a-63ec-4e1c-9341-00f909abff17 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:44.956802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d288a-63ec-4e1c-9341-00f909abff17 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:44.957135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d288a-63ec-4e1c-9341-00f909abff17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:44.982902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-913d288a-63ec-4e1c-9341-00f909abff17 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:44.984100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-913d288a-63ec-4e1c-9341-00f909abff17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:44.991755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 254/508] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:44.997398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:45.007209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05dbd51-befd-4820-b001-226b12bce256 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:45.011409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:45.012075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:45.012433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:45.012747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:45.013497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:45.040921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:45.040921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:45.040921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:45.041950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894ce8-78bf-4346-b028-dc443ee528d8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:45.112043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 255/509] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:04:44 2021] POST /identity/v3/services => generated 269 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:04:47.079007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15e25-4483-4ad3-a2d0-b74a500ae8f1 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.079489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15e25-4483-4ad3-a2d0-b74a500ae8f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.079652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c15e25-4483-4ad3-a2d0-b74a500ae8f1 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.081477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 255/510] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:47.087095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.087441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.087771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.111448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:47.112642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:47.128907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 256/511] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:47 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:47.150655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.150995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.151326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.174663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:47.175846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:47.182827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 256/512] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:47 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:47.188917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:47.198288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b6b4b-8de7-4205-8229-837f7fb40e60 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:47.202356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:47.203161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.204108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.204440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.205136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:47.232581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:47.244166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 12:04:47.245290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 257/513] 10.222.0.18 () {56 vars in 1144 bytes} [Sat Aug 21 12:04:47 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:47.252189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:47.265326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca0c3e-886b-45e8-8b3c-acb3a00786ff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:47.270102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:47.270761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.271098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.271430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.272183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:47.272533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:47.300331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:47.304822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 257/514] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:47 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:47.310558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:47.321004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461f7ed-22ed-4605-84d3-57b397ef2df5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:47.325160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:47.325822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.326189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.326521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.327276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:47.327626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:47.355857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:47.360723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 258/515] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:47 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:47.366096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:47.375941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac8a14-2350-4c1f-b19e-e0bc89df45e1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:47.380039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:47.380663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.380996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.381322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.382175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] RBAC: Adding query filter params (interface=public, service_id=8462ad301e9e4c959d28a43f45837b4f, region_id=RegionOne) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:47.382530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:47.410032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:47.410032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:47.410032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:47.411002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fddfc-c424-4b54-877d-64e56459f063 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:47.417937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 258/516] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:04:47 2021] GET /identity/v3/endpoints?service_id=8462ad301e9e4c959d28a43f45837b4f&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:47.423256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:47.432621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2ead-a3ca-4de5-b265-1b11623bea27 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:47.437031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:47.437659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:47.438513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:47.438844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:47.439550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:47.467664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8fc228-3309-46e3-882c-368cf2e8f328 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:47.472570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 259/517] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:04:47 2021] GET /identity/v3/services => generated 562 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:49.439554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040a86-6f5a-47c3-af5e-cccac988d1dd None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.440072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040a86-6f5a-47c3-af5e-cccac988d1dd None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.440217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d040a86-6f5a-47c3-af5e-cccac988d1dd None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.442105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 259/518] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:49.447607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.447960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.448289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.471995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:49.473183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:49.480040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 260/519] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:49 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:49.502759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.503104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.503440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.527102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:49.528291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:49.535272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 260/520] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:49 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:49.540562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:49.549935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f311018-8da1-45a2-841e-2e9cadb6160e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:49.554019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:49.554825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.555158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.555484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.556177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:49.585283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:49.597325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 12:04:49.598594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 261/521] 10.222.0.18 () {56 vars in 1144 bytes} [Sat Aug 21 12:04:49 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:49.604369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:49.617239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb233-c988-4130-9244-11540f005a60 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:49.621473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:49.622160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.622500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.622835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.623589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:49.623941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:49.653554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:49.658739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 261/522] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:49 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:49.664760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:49.674685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8dd6d-136e-44cb-a3a3-11b7cafc4fac admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:49.678883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:49.679541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.679882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.680214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.680971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:49.681322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:49.710512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e8175-f19d-48fb-94da-66eabdd80f94 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:49.715397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 262/523] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:04:49 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:49.720689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:49.730203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987f036-007c-4d4c-9173-0d7c50b7f290 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:49.734375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:49.735086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:49.735421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:49.735752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:49.736525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:49.764350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:49.764350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:49.764350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:49.765333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff972d8f-432a-432e-a531-617a6d4bee7a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:49.814719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 262/524] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:04:49 2021] POST /identity/v3/endpoints => generated 347 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:04:51.809716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046134-139b-46c7-8a57-3bdc6f9d5ac9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:51.810298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046134-139b-46c7-8a57-3bdc6f9d5ac9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:51.810387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a046134-139b-46c7-8a57-3bdc6f9d5ac9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:51.812509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 263/525] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:51.817921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:51.818274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:51.818613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:51.841910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:51.843108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:51.865692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 263/526] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:51 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:51.887291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:51.887636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:51.887974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:51.911568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:51.912750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:51.919745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 264/527] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:51 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:51.925777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:51.935272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec700d1e-18a3-41f6-b975-c15090726670 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:51.939753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:51.940556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:51.940892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:51.941219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:51.941975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:51.969840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:51.969840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:51.969840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:51.970847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:51.982914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 12:04:51.984170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 264/528] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:51 2021] GET /identity/v3/services/compute => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:51.991019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:52.000106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9249b-b077-416d-9552-0d7c1f20c1dc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:52.004339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:52.004995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:52.005333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:52.005664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:52.006483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:52.006833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:52.035070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de238e-caac-485a-870b-6aa43d63d2bd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:52.039619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 265/529] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:51 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:52.044974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:52.055393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003b318-ab67-484c-84d1-d692fd656ccf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:52.059550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:52.060245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:52.060540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:52.061139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:52.061919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:52.062276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:52.090584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4dbff-b04a-4488-afdd-7969ff7a8b29 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:52.095734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 265/530] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:52 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:54.046686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cd6d-2a84-4c42-aa39-f6e10953f3e5 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:54.047729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cd6d-2a84-4c42-aa39-f6e10953f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:54.047936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cd6d-2a84-4c42-aa39-f6e10953f3e5 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:54.049782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 266/531] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:54.055329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:54.055678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:54.056012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:54.080097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:54.081306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:54.088383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 266/532] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:54 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:54.111140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e691e7-1b79-4a9c-a965-9476f9b03d42 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:54.111476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e691e7-1b79-4a9c-a965-9476f9b03d42 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:54.111813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e691e7-1b79-4a9c-a965-9476f9b03d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:54.134721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-63e691e7-1b79-4a9c-a965-9476f9b03d42 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:54.135904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-63e691e7-1b79-4a9c-a965-9476f9b03d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:54.142838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 267/533] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:54 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:54.148152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:54.158226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f0e077-ff2c-46b7-b79e-fc0f391a89f1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:54.162415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:54.163071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:54.163409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:54.163741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:54.164495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:54.192754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:54.192754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:54.192754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:54.193749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0a9cf-7c83-4053-9e60-227fb32c52a0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:54.237509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 267/534] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:04:54 2021] POST /identity/v3/services => generated 242 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:04:56.198454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee8a3-5e7c-4853-9c1e-23558715f305 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.198955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee8a3-5e7c-4853-9c1e-23558715f305 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.199106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee8a3-5e7c-4853-9c1e-23558715f305 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.200943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 268/535] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:56.207036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.207387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.207724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.230981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:56.232186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:56.249498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 268/536] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:56 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:56.272264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.272606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.272941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.295436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:56.296618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:56.303572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 269/537] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:56 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:56.308810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:56.318959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57175825-dbe6-459d-bf89-d778b11d70d1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:56.323123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:56.323920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.324259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.324590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.325288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:56.353775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:56.365126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 12:04:56.366287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 269/538] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:56 2021] GET /identity/v3/services/compute => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:56.372299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:56.381551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15553680-dcc1-4f4e-a1b5-04d0680449a3 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:56.385691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:56.386357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.386694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.387027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.387772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:56.388120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:56.416426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:56.421016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 270/539] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:56 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:56.426145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:56.435487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb54973-a751-47e6-a33d-615360a9ae7e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:56.440481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:56.441102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.441439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.441771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.442548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:56.442900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:56.471643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:56.476539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 270/540] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:56 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:56.482183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:56.491603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c08dc3-46f9-4cb5-81b5-c9919867fcc1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:56.496271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:56.496898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.497238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.497572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.498431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] RBAC: Adding query filter params (interface=public, service_id=62fabbac19da4c5a835b185d3b647bbe, region_id=RegionOne) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:56.498795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:56.527036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:56.527036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:56.527036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:56.527963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c03a2-ebb5-4b24-8186-486f5ebb9d6f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:56.534270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 271/541] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:04:56 2021] GET /identity/v3/endpoints?service_id=62fabbac19da4c5a835b185d3b647bbe&interface=public®ion_id=RegionOne => generated 194 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:56.540106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:56.550178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7710e2-7f0b-4a57-ae02-20b1ff8accb0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:56.554392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:56.555026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:56.555364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:56.555692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:56.556403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:56.585032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f32d1a-8f60-4e5f-8669-996f12989d45 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:56.590319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 271/542] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:04:56 2021] GET /identity/v3/services => generated 792 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:58.573190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae639d-41c7-466c-8529-1418e6d72225 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.573703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae639d-41c7-466c-8529-1418e6d72225 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.573879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae639d-41c7-466c-8529-1418e6d72225 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.575831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 272/543] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:04:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:04:58.581356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.581702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.582098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.605954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:58.607151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:58.614844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 272/544] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:58 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:58.636399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.636743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.637080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.660412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:04:58.661590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:04:58.668507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 273/545] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:04:58 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:04:58.674494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:58.683811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78005003-16f4-469c-9ead-accbcca99a93 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:58.688213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:58.689004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.689340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.689670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.690428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:58.718210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:58.729988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 12:04:58.731120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 273/546] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:04:58 2021] GET /identity/v3/services/compute => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:04:58.737920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:58.746705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cef76-b5ae-4848-9d63-ecdc83185923 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:58.750840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:58.751479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.751814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.752143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.752928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:58.753275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:58.781008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:58.786052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 274/547] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:58 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:58.791430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:58.801669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c842e-8386-4aea-b933-607d3d3f9019 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:58.805904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:58.806546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.806887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.807220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.807966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:04:58.808317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:58.836928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3416386-0f70-423b-a135-b87cce3c40d0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:58.841756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 274/548] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:04:58 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:04:58.847644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:04:58.857120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab43a1-4038-4dba-a764-05e5225e6eba admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:04:58.861372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:04:58.862028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:04:58.862372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:04:58.862706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:04:58.863493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:04:58.891019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:04:58.891019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:04:58.891019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:04:58.892008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3289e6-ffe3-417f-80a1-afda2b162768 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:04:58.953841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 275/549] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:04:58 2021] POST /identity/v3/endpoints => generated 334 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:00.975818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc460-5358-4844-91a5-74f5345ef246 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:00.976325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc460-5358-4844-91a5-74f5345ef246 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:00.976450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efc460-5358-4844-91a5-74f5345ef246 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:00.978512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 275/550] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:00.983924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:00.984279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:00.984619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.008373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:01.009565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:01.026750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 276/551] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:00 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:01.049574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.049954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.050291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.074438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:01.075628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:01.082760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 276/552] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:01.088132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.097580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7a1c0-98f8-4ef0-873c-2227be71472b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.101776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.102643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.102986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.103322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.115425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:01.123348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:01.124584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:01.131079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.139922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabcec1-b835-48fd-9897-e2cf9ae039f1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.144185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.144836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.145175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.145513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.146341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.146694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.174993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.183630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 277/554] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:01.189632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.199554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fada3-9523-4df5-abb6-081bb704b6c9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.204114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.204944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.205284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.205614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.217700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.246506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.267879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:01.269072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 278/555] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:01.275088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.284907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8373c7-e054-42e5-a8f0-99e55fc16361 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.289128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.289821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.290172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.290507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.291290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.291643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.320875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.334068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:01.339548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.349124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1371-487f-4575-8d59-8ceaf708a3d1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.353328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.354126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.354466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.354795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.368424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.397424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.416778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:05:01.418017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:01.424066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.433755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57585b9-c9db-4343-871e-89c5e3ae8fcc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.438327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.438983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.439324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.439659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.440544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.440897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.469848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.501041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:01.506601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.516158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc388964-457a-4737-93e5-518b834f5d52 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.520255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.520891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.521221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.521548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.530252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.559356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.568567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 280/559] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:01.574645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.584524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da53d5-37f2-46bb-9458-26605e81f2e7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.588776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.589581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.589948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.590286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.602878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.631474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.649506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:01.650685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:01.656625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.665298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654166d4-689b-4520-b798-a9bce30760ec admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.669485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.670163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.670501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.670831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.671590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.672532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.700429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.713495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 281/561] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:01.719437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.728926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080468-4832-4d8c-88f9-74ae5b383f0a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.733052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.733928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.734863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.735199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.746159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.774072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.789076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:01.790231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:01.795811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.805876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d60f20-bbec-404b-bae0-a0d85e1cee72 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.809994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.810881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.811220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.811549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.812376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.812728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.841119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18356f1-f8b6-478a-8ef1-0d1a8aadee9d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.856647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:01.862552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:01.872265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b11054-e5a8-43d1-b889-3b2a8fa8a560 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:01.876452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:01.877097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:01.877436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:01.877768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:01.878688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] RBAC: Adding query filter params (role.id=d0ef1affe62347e3bc0e95700885725a, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:01.879055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:01.908206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23e617-615d-48a2-8a32-2983710643ce admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:01.913856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:01 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=d0ef1affe62347e3bc0e95700885725a => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:03.839078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a028-8b41-4594-a516-6339bc089904 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:03.839622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a028-8b41-4594-a516-6339bc089904 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:03.839729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910a028-8b41-4594-a516-6339bc089904 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:03.841580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 283/565] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:03.846975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:03.847327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:03.847667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:03.871030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:03.872240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:03.879764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 283/566] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:03 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:03.901704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:03.902077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:03.902410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:03.924794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:03.926022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:03.932910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 284/567] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:03 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:03.939166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:03.949281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112376f-195c-437c-9c4d-18534b8dbc5b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:03.954398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:03.955201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:03.955539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:03.955870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:03.967990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:03.975527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:03.976798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:03.983193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:03.992194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a8b77-14f0-4a03-b67d-74e4c45282e3 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:03.996390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:03.997014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:03.997352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:03.997685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:03.998508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:03.998858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.027981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.036657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:04.042326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.053036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec22ed-2855-4f57-9e63-b92514d5cb99 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.057280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.058112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.058453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.058783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.071249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.099337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.118375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:04.119509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:04.125571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.135190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f858-018b-444e-97fd-aeaf7898cb22 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.139413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.140066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.140410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.140741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.141510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:04.141946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.169668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.183275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:04.189534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.199103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5ce06-cba3-4a68-9005-999e4a92c245 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.203296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.204070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.204407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.204737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.217923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.246791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.266431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:05:04.267559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:04.273133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.282636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60e09c-a10d-4fba-ba79-4a037addc1c6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.286828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.287476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.287815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.288148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.289023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:04.289377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.318808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.348881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:04.354319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.364374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c06ad8-2693-4a79-a1b3-6b024fe6df04 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.368520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.369292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.369626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.369986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.382934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.411490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.429781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:04.430916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 287/574] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:04.436544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.446105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6424ef-7a6b-4984-8b59-a245d0444c39 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.450310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.450952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.451291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.451619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.452379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:04.452725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.480936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.494354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 288/575] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:04.499643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.509179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57623a7-7c59-4ee3-9392-f73cd6ab5bf0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.513348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.514175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.514514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.514845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.523949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.553136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.568056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:04.569258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 288/576] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:04.574619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.584023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b76d46-28ac-4d34-a637-3ecf30fa3f07 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.588193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.588824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.589158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.589490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.590349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:04.590702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.619721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea407c-3012-4282-be41-35ebb19f9aa8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.633210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 289/577] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:04.639180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:04.649125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9f700-e9df-4bdd-a089-5d125024c45f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:04.653507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:04.654453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:04.654795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:04.655129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/d0ef1affe62347e3bc0e95700885725a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:04.657839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=d950460ecfe846a7ab6f4933bd97454e, role_id=d0ef1affe62347e3bc0e95700885725a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:04.687827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519841df-0edc-4d44-b4cd-7464975997d3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:04.728168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 289/578] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:05:04 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/d950460ecfe846a7ab6f4933bd97454e/roles/d0ef1affe62347e3bc0e95700885725a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:05:06.692468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037951b6-fd37-4b53-b0f6-4b375f611046 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.692984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037951b6-fd37-4b53-b0f6-4b375f611046 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.693110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037951b6-fd37-4b53-b0f6-4b375f611046 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.694971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 290/579] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:06.700364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.700716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.701052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.725174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:06.726433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:06.793198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 290/580] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:06.816545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.816892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.817227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.840373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:06.841558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:06.848486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 291/581] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:06.853909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:06.863479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c3d90-c78f-48bf-a3cd-9fbc73fc3a6c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:06.867715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:06.868532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.868870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.869203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.881598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:06.889483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:06.891270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 291/582] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:06.897549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:06.906732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9668dc-2c64-4aa5-8c27-d2d475859e77 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:06.910984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:06.911691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.912029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.912361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.913149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:06.913500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:06.942188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:06.950943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 292/583] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:06.956891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:06.967057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573fb90-4869-44a6-959d-4b3ade82addf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:06.971305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:06.972095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:06.972695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:06.972820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:06.984553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.013434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.033682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:07.034922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 292/584] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:07.040915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.051258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03311a1f-d515-4353-a1b5-d1eae5d9cc80 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.055398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.056048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.056388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.056719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.057777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:07.058165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.086752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.099778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 293/585] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:07.105201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.115285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a95a-1d7c-48a8-a9ba-1b51016b5175 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.119447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.120221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.120554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.120884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.137272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.165380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.184730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 12:05:07.186134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 293/586] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:07.192420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.202212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810fdb5-f10b-4f0b-9417-8e29898637ca admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.206357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.207015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.207354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.207686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.208575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:07.208932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.237434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.268174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 294/587] 10.222.0.18 () {56 vars in 1145 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:07.273799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.283552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534233-e46f-456b-a891-87c2895b928d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.287777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.288407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.288749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.289085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.297819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.344393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.356023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 294/588] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:07.362656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.372536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8794350-8700-4909-a9d7-bff4a7236d09 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.377386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.378240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.378582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.378917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.390884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.419496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.438214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:07.439371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 295/589] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:07.445042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.454181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af68a3-9c1d-4049-94b1-847b0cdd604f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.458557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.459223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.459559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.459885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.460654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:07.461005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.489891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.505863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 295/590] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:07.508996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.518617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca51058-b8d9-48c6-b63c-e2efacadb5a5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.522821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.523597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.523931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.524259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.534063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.563133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.577760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:07.578998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 296/591] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:07.584437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.594396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2189606-c8ce-4d36-a454-cd44e87043e7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.598517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.599151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.599482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.599807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.600621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:07.600968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.629511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea958d2-75e1-4983-8f50-9cd0610f8193 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.643133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 296/592] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:07.649175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:07.659488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19e53-e55d-42d4-8a78-3d0654f9b38a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:07.663678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:07.664320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:07.664660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:07.664995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:07.665903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] RBAC: Adding query filter params (role.id=d0ef1affe62347e3bc0e95700885725a, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=d950460ecfe846a7ab6f4933bd97454e) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:07.666266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:07.695294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b394ba6-8dde-4324-91cf-2793220ee3b6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:07.701236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 297/593] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:07 2021] GET /identity/v3/role_assignments?user.id=d950460ecfe846a7ab6f4933bd97454e&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=d0ef1affe62347e3bc0e95700885725a => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:09.742778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d623a-9ee6-4ab5-b4e9-ccef0c8bbc4d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:09.743384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d623a-9ee6-4ab5-b4e9-ccef0c8bbc4d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:09.743494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d623a-9ee6-4ab5-b4e9-ccef0c8bbc4d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:09.745260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 297/594] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:09.751195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:09.751548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:09.751885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:09.777670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:09.778899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:09.785937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 298/595] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:09 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:09.807733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:09.808074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:09.808407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:09.832388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:09.833584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:09.840576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 298/596] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:09 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:09.845989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:09.855369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dfd95-0e74-492d-ade6-bcb60f8cb2e1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:09.859718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:09.860511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:09.860848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:09.861176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:09.873132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:09.902269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:09.920090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:09.921239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 299/597] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:09.927356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:09.936570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f917152-ef23-4811-a0e2-9f8b2e6bf1f7 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:09.941236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:09.941918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:09.942261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:09.942595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:09.943371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:09.943725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:09.972348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0f356-77c6-4411-ba43-41b5484b0520 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:09.986180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 299/598] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:09.993164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:10.003504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be69992-baa0-41c4-8217-9ae0c65340d3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:10.007632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:10.008295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:10.008630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:10.008959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:10.009678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:10.038549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e95a8f-9435-45d9-8f97-d6f04fe5c628 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:10.088266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 300/599] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:05:09 2021] POST /identity/v3/users => generated 248 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:12.068218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ae68-ecd6-49ee-9da3-6aa95b5b3f3f None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.068750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ae68-ecd6-49ee-9da3-6aa95b5b3f3f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.068862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ae68-ecd6-49ee-9da3-6aa95b5b3f3f None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.070768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 300/600] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:12.076091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.076440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.076777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.100063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:12.101257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:12.108280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 301/601] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:12 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:12.130960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.131312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.131652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.154231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:12.155420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:12.163300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 301/602] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:12 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:12.168617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.178649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04406b7a-fee4-49a4-86bb-9241879c2765 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.182888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.183685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.184018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.184349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.196247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:12.203633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:12.204784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 302/603] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:12.210676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.219991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62a72-96be-47e4-b3a7-df31293abc89 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.224198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.224848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.225187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.225521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.226355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.226707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.255529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.264543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 302/604] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:12.270435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.280682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd368f-0964-4879-9025-1efa730f056d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.285403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.286223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.286560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.286886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.299344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.328139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.347605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:12.348760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 303/605] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:12.354709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.364538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f5d75-bc43-4a1d-9477-6f39e93520cd admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.368773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.369436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.369778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.370181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.370958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.371312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.399683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.413511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 303/606] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:12.418937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.428566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbaafc-f2ae-4786-8e34-92ef75f611a8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.432684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.433474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.433825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.434196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.447596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.476811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.496464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 12:05:12.497594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 304/607] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/users/glance => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:12.503243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.512965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0498a-032e-4ed3-b411-c375471fe32b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.517608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.518294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.518633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.518968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.519851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.520207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.548873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.579858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 304/608] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:12.585464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.595760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bd33-2f23-400e-a0df-81391c88b17c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.599980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.600615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.600951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.601279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.610945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.638692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.648332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 305/609] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:12.654420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.664918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4ebe62-7e98-4ea9-9813-086d69598224 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.669179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.670005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.670344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.670672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.682611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.712121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.729931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:12.731081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 305/610] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:12.736665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.745517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413580-71eb-402f-afbe-be8eac5b502e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.750270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.750923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.751259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.751591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.752359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.752710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.781126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.793475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 306/611] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:12.798951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.808507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1e879-25d1-4e1c-850c-a8af47de4fcc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.813424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.814225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.814563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.814893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.823904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.852991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.867882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:12.869034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 306/612] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:12.875297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.884871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0921f9-e214-4dea-97b7-a5c583341825 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.889062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.889703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.890073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.890935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.891776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.892131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.920194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05d68e-d9d4-432a-8f4b-d98ba1070bd2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.933911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 307/613] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:12.940772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:12.950664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadef91c-c42d-417f-bbc1-e5731a2667a2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:12.955533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:12.956175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:12.956514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:12.956844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:12.957719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=ae4fdee19f3c4821b3831f77f2273d52) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:12.958107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:12.986728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24481dcc-133b-42ad-8e22-a1cb3960b37b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:12.992762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 307/614] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:12 2021] GET /identity/v3/role_assignments?user.id=ae4fdee19f3c4821b3831f77f2273d52&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:14.930835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c6ae-5712-437c-888a-1c1f52bcd5fd None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:14.931376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c6ae-5712-437c-888a-1c1f52bcd5fd None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:14.931475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02c6ae-5712-437c-888a-1c1f52bcd5fd None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:14.933312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 308/615] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:14.939095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:14.939446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:14.939783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:14.963359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:14.964580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:14.972301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 308/616] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:14 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:14.994869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:14.995214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:14.995549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.018227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:15.019415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:15.026381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 309/617] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:14 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:15.032508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.042044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f9a26-468a-4038-9929-7fcc50c7f0ab None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.046239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.047585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.047920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.048245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.059967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:15.067693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:15.068853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 309/618] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:15.074864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.083608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917266-cde0-4bd3-a336-f6a0e56b3636 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.087796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.088437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.088772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.089096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.089907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:15.090255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.119063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.127701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 310/619] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:15.132977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.145276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52d024-805d-4a15-93ed-1dbc03e57cc0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.149479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.150272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.150612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.150942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.163033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.192029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.210575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:15.211714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 310/620] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:15.217217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.227259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852001e3-64d6-4429-ae05-daee71d1b742 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.231407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.232052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.232386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.232714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.233474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:15.234457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.262152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.275157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 311/621] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:15.280441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.290481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437557a2-6568-4e1d-a02a-658c7864cd82 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.294675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.295437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.295773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.296103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.309922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.339002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.358614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 12:05:15.359730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 311/622] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/users/glance => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:15.365161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.374589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec371ffa-4b38-495e-b131-9a9852d8b337 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.378730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656970-add8-4100-864a-787aaee24555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.379375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656970-add8-4100-864a-787aaee24555 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.379713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656970-add8-4100-864a-787aaee24555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.380045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de656970-add8-4100-864a-787aaee24555 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.380922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656970-add8-4100-864a-787aaee24555 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:15.381272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656970-add8-4100-864a-787aaee24555 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.410305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de656970-add8-4100-864a-787aaee24555 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.442315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 312/623] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:15.447751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.457842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe297-588b-4cb5-b828-2e0697be60e2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.461995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.462768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.463100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.463424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.476402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.504823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.523098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:15.524218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 312/624] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:15.529651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656970-add8-4100-864a-787aaee24555 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.539701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de656970-add8-4100-864a-787aaee24555 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.543844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.544482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.544818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.545147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.545939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:15.546288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.574204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.587022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 313/625] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:15.592639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.606302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a344c2b-42d6-46de-8dcf-eb68e8e5fd92 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.610544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.611331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.611670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.612004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.621201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.649822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.665077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:15.666247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 313/626] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:15.671882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.681458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346773f-34d1-4376-8eda-3f7f91d02280 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.685885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.686523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.687357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.687670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.688520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:15.688872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.717530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33cfe1-5123-4401-b99b-0bf8b1410eb7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.730776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 314/627] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:15.736534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:15.746080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a93f7-66e1-4ae1-baab-76569b68b309 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:15.750704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:15.751571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:15.751909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:15.752236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/ae4fdee19f3c4821b3831f77f2273d52/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:15.773150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=ae4fdee19f3c4821b3831f77f2273d52, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:15.801758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48287b02-a67c-498d-b87d-ac350150a26f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:15.873244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 314/628] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:05:15 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/ae4fdee19f3c4821b3831f77f2273d52/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:05:17.812513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cac8-ed2c-4a66-9571-14a5d31deeb9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:17.813034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cac8-ed2c-4a66-9571-14a5d31deeb9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:17.813148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058cac8-ed2c-4a66-9571-14a5d31deeb9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:17.814990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 315/629] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:17.820534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:17.820881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:17.821219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:17.844763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:17.846005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:17.912579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 315/630] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:17 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:17.935219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:17.935820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:17.936159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:17.958682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:17.959883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:17.967128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 316/631] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:17 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:17.973081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:17.982637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b2d37-c8e2-46c3-a69c-3d098eff6e51 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:17.987460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:17.988263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:17.988597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:17.988923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.000659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:18.007925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:18.009098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 316/632] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:18.015504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.024560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a84b-facd-4edf-b96b-987e10a75028 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.028866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.029540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.029911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.030242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.031534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.031883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.060246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.069423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 317/633] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:18.074762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.084775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d06c52-9231-4ffa-86ef-795d0c0464d8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.088915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.089687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.090049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.090382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.102379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.131097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.149436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:18.150581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 317/634] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:18.156468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.166218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad788038-f5ec-4bd7-a8e2-175e744760d4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.170474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.171143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.172020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.172356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.173153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.173509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.201711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.215105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 318/635] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:18.221028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.230559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68c60b-57bd-4886-af8c-4468a66113a6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.235235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.236009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.236344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.236672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.249862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.277995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.298079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 12:05:18.299209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 318/636] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:18.304686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.314619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f58b1-2662-4ea3-b1d6-76910ec1d5ff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.318848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.319545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.319845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.320179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.321065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.321422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.350697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.380855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 319/637] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:18.386337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.396451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce4a7e-0a69-4b24-9b71-26af560ee4bf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.400618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.401245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.401582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.401944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.413842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.441956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.450810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 319/638] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:18.456676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.466296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b6f4-0543-4e17-bbc1-c83d119aee09 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.471070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.471856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.472193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.472520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.484345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.512886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.531815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:18.532940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 320/639] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:18.538403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.547222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21f49-1852-42dc-aed0-b0db7dd971df admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.551483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.552130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.552467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.552799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.553566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.553948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.582647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.595743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 320/640] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:18.600889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.610362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f8ed0-c470-4b47-b219-034347769614 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.614468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.615202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.615536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.615924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.624829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.653261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.668411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:18.669518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 321/641] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:18.674920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.684406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33d89b-dc6a-42cc-ac68-7da5813f52bf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.689276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.689945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.690285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.690616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.691440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.691795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.720309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853893c-68e6-4b2e-90c5-5eef3938cefd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.733614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 321/642] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:18.739263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:18.748515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d714b2-6035-42cd-8a93-d0e6d5dedb53 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:18.753067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:18.753681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:18.754060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:18.754391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:18.755253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=ae4fdee19f3c4821b3831f77f2273d52) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:18.755604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:18.784057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8fcac-5dfb-40e4-a9ea-270bc9215fcd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:18.789961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 322/643] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:18 2021] GET /identity/v3/role_assignments?user.id=ae4fdee19f3c4821b3831f77f2273d52&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:20.805451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157c0a-1209-400e-a81a-b889e977b6f1 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:20.806016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157c0a-1209-400e-a81a-b889e977b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:20.806134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a157c0a-1209-400e-a81a-b889e977b6f1 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:20.807957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 322/644] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:20.814301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:20.814652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:20.814988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:20.838172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:20.839357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:20.846597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 323/645] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:20 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:20.868820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:20.869169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:20.869506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:20.892714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:20.893941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:20.900948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 323/646] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:20 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:20.906768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:20.916161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de644cc1-8deb-4f1f-89e2-fb4c21e02596 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:20.920307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:20.921697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:20.922099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:20.922433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:20.934375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:20.962742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:20.981377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:20.982680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 324/647] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:20.989616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:20.998827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75514e75-d03f-4e7c-8e92-c8cec1a5afed None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:21.003093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:21.003748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:21.004084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:21.004418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:21.005192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:21.005542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:21.033917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d09352-2ad5-4768-8747-f43a2b12fc46 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:21.047621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:21.053094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:21.063020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42401b-2951-443b-8874-5edb59a78eef admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:21.067099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:21.067804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:21.068138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:21.068466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:21.069181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:21.097638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c908bcac-9d08-455f-b111-6ed7f5bee779 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:21.288145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 325/649] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:05:21 2021] POST /identity/v3/users => generated 254 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:23.267224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772a65-98a3-4628-b0ec-8f3474573af1 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.267725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772a65-98a3-4628-b0ec-8f3474573af1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.267831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb772a65-98a3-4628-b0ec-8f3474573af1 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.269595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 325/650] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:23.275082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.275436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.275774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.298569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:23.299780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:23.306831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 326/651] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:23 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:23.329523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.329905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.330237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.352651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:23.353843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:23.360785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 326/652] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:23 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:23.366021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.375919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa0f5b-36e5-4c09-a034-59b9fe08ea05 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.380121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.380916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.381254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.381587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.393865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:23.401224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:23.402404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:23.408191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.416928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce07e5d-c209-4a69-922b-83381f0df322 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.421073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.421710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.422090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.422419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.423205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:23.423556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.451967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.461212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:23.466532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.478834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306c6d8-fbdb-4478-a10f-cd62668e5a44 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.483022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.483778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.484118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.484449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.496378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.525456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.543978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:23.545115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 328/655] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:23.551068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.560827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b47bf0-83d4-4a43-a55d-4c8ce325d30b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.565531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.566196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.566534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.566866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.567620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:23.567971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.595602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.609053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 328/656] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:23.614356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.623980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524b630-a771-4f48-bdd5-202f29620e51 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.628753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.629546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.629915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.630250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.643488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.672406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.692756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:23.693913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 329/657] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:23.699291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.708923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d45a7-e3bb-40e2-9e84-7782d89e7a0a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.713129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.713781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.714178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.714507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.715387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:23.715741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.744354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.775621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 329/658] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:23.781093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.790706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923809e-f9c0-4036-a2b1-bcee010dd914 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.794872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.795504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.795846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.796668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.804763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.833538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.842446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 330/659] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:23.847690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.857159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57372b-1576-45da-a8e6-e0569d9f4e03 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.861857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.862642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.862982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.863313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.875950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.903935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.922966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:23.924170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 330/660] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:23.929486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:23.938631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66457d1c-d362-4039-ad8d-f6ba86956dc4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:23.942856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:23.943500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:23.943844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:23.944177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:23.944937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:23.945288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:23.974143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:23.988371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 331/661] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:23.994052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:24.003865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06b8b9-c30d-4596-8e70-cae2b0167b1c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:24.008100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:24.008894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:24.009228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:24.009556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:24.018716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:24.047939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:24.062939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:24.064087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 331/662] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:24.069780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:24.079542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec49a1-6e34-4011-b0cb-46b064d0a9f0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:24.083775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:24.084426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:24.084767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:24.085103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:24.085980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:24.086340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:24.117255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc431e6-7d4b-477b-8703-d39b427d776f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:24.130746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:24.136512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:24.146124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a999992-5c3e-4877-afaf-99ef5c3b2b4f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:24.150228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:24.150858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:24.151191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:24.151518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:24.152382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=7a65d2ef73b4425583ec25dbe6301097) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:24.152737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:24.181587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c397320-b77e-4ea4-8dfe-32cc5b49d8db admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:24.187344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 332/664] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:24 2021] GET /identity/v3/role_assignments?user.id=7a65d2ef73b4425583ec25dbe6301097&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.123033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4eff-0150-45c9-988f-292444e8ee67 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.123550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4eff-0150-45c9-988f-292444e8ee67 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.123690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4eff-0150-45c9-988f-292444e8ee67 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.125563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 333/665] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:26.131039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.131388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.131718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.156016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:26.157218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:26.164217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 333/666] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:26 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:26.185606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.185993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.186335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.210257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:26.211448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:26.218506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 334/667] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:26 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:26.224023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.233590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5906c6-b653-40ee-b507-1f6d30b6d95c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.237841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.238659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.239000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.239332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.251645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:26.259070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:26.260320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 334/668] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:26.267068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.276045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb0001-8c49-42bd-8770-f766ab691fa4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.280282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.280976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.281316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.281653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.282493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:26.282847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.310912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.320094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 335/669] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.325342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.336144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e1fb4-7393-4a55-9bc7-7d790cc36dda admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.340406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.341176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.341518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.341880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.353572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.382187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.403234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:26.404365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:26.409782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.419371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28581f6-c874-436d-8933-60f9e963990e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.423571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.424257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.424593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.424929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.425692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:26.426088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.455752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.468886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 336/671] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.474222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.483824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3eef7-e349-454a-980c-cad81fc24580 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.487986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.488773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.489114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.489449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.503711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.533745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.554321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:26.555516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 336/672] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:26.562424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.572234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c2712-b093-41c7-955b-7337f1f7a743 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.576420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.577089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.577430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.577762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.578686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:26.579043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.607112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.638247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 337/673] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.643689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.653334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb013f8-fb5a-4fc2-aa61-7e44a99a4e90 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.657582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.658397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.658735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.659109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.672053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.700844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.718802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:26.719943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 337/674] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:26.725491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.735690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3b509-88cb-4878-8610-7792cfa906ff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.739959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.740615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.740954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.741287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.742103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:26.742452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.770750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.783149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 338/675] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.788436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.798535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85b523-18e9-4774-9fdb-77434b793205 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.802796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.803563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.803897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.804228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.814204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.842392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.857184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:26.858354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 338/676] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:26.864395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.873821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f667d5-0c34-4932-bf8c-b82fe5ec8137 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.878662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.879299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.879634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.879963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.880789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:26.881141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.909446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635b475-5d79-4bdb-a375-a8c65d9406ca admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:26.923188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 339/677] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:26.928778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:26.938667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db724141-1971-4682-a33a-cf0f8859fd67 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:26.942856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:26.943718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:26.944054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:26.944384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/7a65d2ef73b4425583ec25dbe6301097/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:26.964987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=7a65d2ef73b4425583ec25dbe6301097, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:26.995019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436430a4-7254-4e63-8f86-196538f30562 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:27.037049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 339/678] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:05:26 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/7a65d2ef73b4425583ec25dbe6301097/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:05:28.977829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6f4c-a93d-4f8b-a20c-a930e91962ef None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:28.978334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6f4c-a93d-4f8b-a20c-a930e91962ef None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:28.978485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6f4c-a93d-4f8b-a20c-a930e91962ef None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:28.980506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 340/679] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:28.986123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:28.986476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:28.986809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.010078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:29.011271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:29.076838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 340/680] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:28 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:29.099878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.100214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.100546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.123026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:29.124235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:29.131206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 341/681] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:29 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:29.136646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.146462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bafb82-b002-42de-a247-6ccaf3550e00 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.150614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.151409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.151743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.152074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.164176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:29.171519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:29.172743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 341/682] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:29.178824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.188596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62333cb7-5d31-48e5-92b9-d85c558ed926 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.192860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.193512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.193881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.194224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.195020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.195375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.223935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.232639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 342/683] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:29.238162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.248240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bdc90-f366-4a24-82af-b7ef16b6f66e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.252920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.253687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.254068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.254402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.266642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.294644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.314051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:29.315171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 342/684] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:29.320561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.330605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e8f43-2e6e-4d6a-af19-d93a9cfe43a0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.334770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.335405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.335740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.336066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.336821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.337167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.365021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.378461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 343/685] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:29.383821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.393891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ecc21-1fcb-4ad9-af7a-66ceff6dea6a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.398071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.398852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.399189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.399520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.412679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.441984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.462095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:29.463215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 343/686] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:29.468730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.478178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1ad5-89bd-4f44-8aab-814460c0c546 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.482364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.483049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.483342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.483673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.484548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.484903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.513813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.546540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 344/687] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:29.552274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.562700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96a107-4c25-4e92-9776-902ec39b4c4e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.566837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.567465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.567798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.568129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.576938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.604875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.614150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 344/688] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:29.619633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.629825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73355a01-aa0e-493d-9802-eb08b816b6d5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.634005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.634784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.635123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.635454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.647404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.675820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.694622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:29.695853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 345/689] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:29.701229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.710059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b97f4d-0951-41ba-88f7-57802d7c854c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.714316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.714952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.715286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.715615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.716366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.716712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.745198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.758123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 345/690] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:29.763521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.773055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9e1d2-9ef3-4539-afd5-753426afcf23 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.777191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.778019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.778359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.778689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.787711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.817150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.831784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:29.832918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 346/691] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:29.838497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.847927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685201-dcee-4c2a-a2b3-fa49fa7fef3c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.852058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.852691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.853026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.853357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.854207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.854560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.883561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e6fbb-e7ff-4809-b16e-f21c4feda0e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.899094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 346/692] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:29.904991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:29.915029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e208a-cfa5-4b59-b00d-8c8c9cf3df5e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:29.919181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:29.919809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:29.920146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:29.920476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:29.922010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=7a65d2ef73b4425583ec25dbe6301097) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:29.922368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:29.950459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67535a78-f06a-4781-9114-7920a823d519 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:29.956469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 347/693] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:29 2021] GET /identity/v3/role_assignments?user.id=7a65d2ef73b4425583ec25dbe6301097&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:31.965025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff37a2-4f68-43a7-846e-bc38d3b85883 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:31.965547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff37a2-4f68-43a7-846e-bc38d3b85883 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:31.965680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff37a2-4f68-43a7-846e-bc38d3b85883 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:31.968217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 347/694] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:31.973590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:31.974012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:31.974352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:31.997895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:31.998987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:32.006041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 348/695] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:31 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:32.028495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.028845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.029181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.126845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:32.128064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:32.135141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 348/696] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:32 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:32.141514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.151051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d61ea-4f58-4ca4-944a-3f089ca1c983 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.155800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.156607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.156942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.157267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.168841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:32.176585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:32.177744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 349/697] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:32.183839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.193472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268215f0-1e5d-4f54-a014-9b4427008997 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.197669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.198364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.198706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.199040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.199833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.200182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.228478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.237127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 349/698] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:32.242904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.253496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c64b8-1ae7-45e4-9a83-3f234c5f64e0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.257649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.258454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.258791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.259119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.271276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.299149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.318324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:32.319451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 350/699] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:32.324907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.334994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e7363-8336-4c98-b6d1-185ab76559c1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.339095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.339736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.340069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.340396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.341154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.341500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.368925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.382442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 350/700] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:32.387623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.397639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f7df0-3fd9-4c2c-81b4-5da2a44beebd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.401768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.402569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.402902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.403229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.416329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.445085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.465014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:32.466170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 351/701] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:32.471567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.480964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301ec7-30bf-4eac-902f-42dc939c439c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.485039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.485720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.486087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.486423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.487293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.487644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.517019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.547399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 351/702] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:32.552965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.563476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cbc5-79fc-466c-b5df-742306d7d5bb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.567647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.568274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.568614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.568945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.577763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.605531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.614890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 352/703] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:32.620154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.630106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59bd86-5735-4475-bac9-781c7c2a09b2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.634255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.635025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.635360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.635689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.647514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.675915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.694592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:32.695716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 352/704] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:32.701025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.709863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e209b4-399c-4257-a1db-f3a81bf72528 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.714094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.714735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.715075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.715406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.716191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.716539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.744823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.757935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 353/705] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:32.763070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.772440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbe12a-752c-4f4e-9cc1-1674c0578ef5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.776587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.777338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.777672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.778059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.786953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.816151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.830757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:32.831862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 353/706] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:32.837199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.846691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3e4dd-653b-4b7d-806d-3f36b7729dcf admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.850838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.851476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.851815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.852151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.852977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.853332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.882333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9a1c6-d16a-4554-ad65-44f8c3c8d41a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.895718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 354/707] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:32.901323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:32.911259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b4173-2bc8-4bb8-b367-35f0e734cf3b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:32.915424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:32.916044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:32.916378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:32.916729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:32.917585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] RBAC: Adding query filter params (role.id=d0ef1affe62347e3bc0e95700885725a, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=7a65d2ef73b4425583ec25dbe6301097) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:32.917972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:32.946567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989bd79-61b5-48bf-87cd-3b46ea53f80b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:32.952000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 354/708] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:32 2021] GET /identity/v3/role_assignments?user.id=7a65d2ef73b4425583ec25dbe6301097&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=d0ef1affe62347e3bc0e95700885725a => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:34.911120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829cb1-24f2-4a15-b034-722c23395980 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:34.911676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829cb1-24f2-4a15-b034-722c23395980 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:34.911785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829cb1-24f2-4a15-b034-722c23395980 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:34.913598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 355/709] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:34.919046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:34.919402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:34.919743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:34.943475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:34.944691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:34.951803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 355/710] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:34 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:34.974479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:34.974829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:34.975170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:34.998281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:34.999503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:35.006567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 356/711] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:34 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:35.012282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.022405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66e8f-a28e-4ddc-a92b-2bcc9171c088 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.026590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.027409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.027747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.028074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.040392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:35.048174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:35.049337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 356/712] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:35.055362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.064478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6d970-8ae5-4ca8-80b5-f5ba11210263 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.068685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.069336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.069672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.070033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.070827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:35.071177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.099926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.108648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 357/713] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:35.113864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.123855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1452ee-a65d-4df8-a818-a561f2dbfffa admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.128056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.128827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.129166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.129498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.142141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.170191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.189650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:35.190836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 357/714] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:35.196674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.207013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acd052-82fe-4fb5-bd7d-df7fe6bc49f6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.211151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.211798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.212134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.212464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.213232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:35.213580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.241456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.255031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 358/715] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:35.260405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.270689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988f9de-1e72-4d41-a19e-8ec31659d401 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.274849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.275646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.275982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.276312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.289556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.318595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.338779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:35.339908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 358/716] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:35.345452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.354974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01c351-abdd-440a-88bd-ee7ed18f0502 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.359140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.359793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.360130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.360463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.361336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:35.361689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.390770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.422720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:35.428259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.438752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd14828d-9c19-4b81-9e0f-ce8f11252545 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.442905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.443692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.444026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.444355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.457580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.485753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.505669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:35.506908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:35.512881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.523223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123f769-e2d2-47a1-ae4e-9bd32d7bb705 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.527375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.528030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.528366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.528697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.529465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:35.529839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.557886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.571108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:35.576572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.586214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574642a5-efa9-48c5-bf28-1acd3b99bdc9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.590385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.591204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.591543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.591878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.600954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.630070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.644778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:35.645932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 360/720] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:35.651485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.660878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b55a0d-cb55-4ecd-a575-92579f77dc8b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.665018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.665652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.666023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.666355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.667178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:35.667530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.696531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f3662-b974-4c32-af5d-8785089fd520 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.709774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 361/721] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:35.715405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:35.724895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026061-2ba9-4371-a2fd-58921cc95f9c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:35.729007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:35.729909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:35.730245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:35.730571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/7a65d2ef73b4425583ec25dbe6301097/roles/d0ef1affe62347e3bc0e95700885725a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:35.732696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=7a65d2ef73b4425583ec25dbe6301097, role_id=d0ef1affe62347e3bc0e95700885725a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:35.762793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c811704-5628-4497-9582-763d81a9d118 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:35.807651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 361/722] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:05:35 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/7a65d2ef73b4425583ec25dbe6301097/roles/d0ef1affe62347e3bc0e95700885725a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:05:37.756762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d65f-e227-4d97-af4c-ff50e3f44221 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:37.757300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d65f-e227-4d97-af4c-ff50e3f44221 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:37.757391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6d65f-e227-4d97-af4c-ff50e3f44221 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:37.759257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 362/723] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:37.764730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:37.765082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:37.765419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:37.791497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:37.792693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:37.859538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 362/724] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:37.882249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:37.882587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:37.882921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:37.906782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:37.907988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:37.914985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 363/725] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:37.920504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:37.930046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1f9c6-6f10-4997-93ba-564c2500838c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:37.934286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:37.935359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:37.935698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:37.936028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:37.947735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:37.956075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 12:05:37.957235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 363/726] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Aug 21 12:05:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:37.963167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:37.972690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d89d11-b642-4bf2-955c-bd6ffa83124f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:37.976876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:37.977533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:37.977909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:37.978247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:37.979038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:37.979388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.007146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.016399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 364/727] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:05:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:38.022227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.033021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322a225-63a0-4927-a1c2-3000b14d0bdc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.037200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.038037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.038372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.038700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.050260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.079089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.098093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:38.099229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 364/728] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:38.104730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.114221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d816d-231b-4e00-b25b-30386a627f26 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.118356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.118999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.119336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.119668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.120434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:38.120782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.148930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.162797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 365/729] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:38.168505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.178531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148dc2e1-6afe-4891-8779-2889dcfa5947 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.182855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.183673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.184015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.184351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.198460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.229205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.250250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 12:05:38.251401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 365/730] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:38.257203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.267515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6b3dd-54f1-4345-b6d1-dab9023196e0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.271908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.272565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.272903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.273234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.274160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:38.274518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.302645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.334102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 366/731] 10.222.0.18 () {56 vars in 1161 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:38.339796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.349502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0b831-1633-41f8-bbd4-9feb968a471e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.353731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.354418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.354757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.355088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.363225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.392274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.401202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 366/732] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:38.406740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.416291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6887c3a-ef15-45cd-8784-74287c64b6e2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.420470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.421258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.421598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.421970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.433905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.463300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.481263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:38.482471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 367/733] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:38.487970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.497247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81d969-a944-4cb9-8b8b-76daf221ff7e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.501973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.502612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.502942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.503267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.504023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:38.504371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.532601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.546103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 367/734] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:38.551377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.561885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a11d2-8939-4f94-860d-19199fbdf59b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.566106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.566885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.567226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.567563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.576685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.604708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.619940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:38.621071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 368/735] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:38.627124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.636497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb212a-f2f6-4188-ae3b-bd60f7b32e74 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.640635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.641265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.641600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.641964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.642780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:38.643131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.671490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a450-64ce-40db-a899-171d0e30e063 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.684641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 368/736] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:38.691135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:38.700750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c1fc-9887-4966-bae5-e722f93a54d1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:38.704953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:38.705586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:38.705958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:38.706295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:38.707164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] RBAC: Adding query filter params (role.id=d0ef1affe62347e3bc0e95700885725a, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=7a65d2ef73b4425583ec25dbe6301097) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:38.707537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:38.735826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d2934-1f48-448f-8c17-38ffc7bfca44 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:38.741919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 369/737] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:38 2021] GET /identity/v3/role_assignments?user.id=7a65d2ef73b4425583ec25dbe6301097&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=d0ef1affe62347e3bc0e95700885725a => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:40.744901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369dc-ef05-4b23-9c3a-4ca69d5e2c8e None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.745469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369dc-ef05-4b23-9c3a-4ca69d5e2c8e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.745582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa369dc-ef05-4b23-9c3a-4ca69d5e2c8e None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.747393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 369/738] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:40.752941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.753298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.753640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.777738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:40.779007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:40.786706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 370/739] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:40.810338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.816543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.816543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.834180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:40.835367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:40.842959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 370/740] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:40.848325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:40.857931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a7e2c-d6cd-4f91-a866-929516a45229 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:40.862141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:40.862938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.863281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.863618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.864321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:40.892710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:40.903916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 12:05:40.905677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 371/741] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Aug 21 12:05:40 2021] GET /identity/v3/services/image => generated 86 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:40.911887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:40.920783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556722-66bd-49e3-b1a2-d6a3eaaa70ff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:40.924969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:40.925613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.925974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.926304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.927050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] RBAC: Adding query filter params (name=image) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:40.927395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:40.956002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0756d-ef39-41c3-aa58-3df3d799b0fa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:40.960530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 371/742] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:40 2021] GET /identity/v3/services?name=image => generated 122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:40.965896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:40.976109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958878f7-dff8-4711-84ab-525c67760218 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:40.980379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:40.981038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:40.981378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:40.981711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:40.982494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:40.982848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:41.010612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de9ae3-7d4e-4375-80ef-caf0ecd470f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:41.015677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 372/743] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:40 2021] GET /identity/v3/services?type=image => generated 122 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:42.981630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88373c1-6fc4-4259-ad6d-f86629688679 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:42.982215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88373c1-6fc4-4259-ad6d-f86629688679 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:42.982315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88373c1-6fc4-4259-ad6d-f86629688679 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:42.984166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 372/744] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:42.989671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:42.990128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:42.990541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:43.015289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:43.016496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:43.023548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 373/745] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:42 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:43.045013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb85-3f4e-4333-aca8-9f58116b69f8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:43.045887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb85-3f4e-4333-aca8-9f58116b69f8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:43.046228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025eb85-3f4e-4333-aca8-9f58116b69f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:43.070052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7025eb85-3f4e-4333-aca8-9f58116b69f8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:43.071228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7025eb85-3f4e-4333-aca8-9f58116b69f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:43.078213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 373/746] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:43 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:43.083554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:43.092939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1576-09cb-4ad2-8964-04b426a6ab2c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:43.097119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:43.097798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:43.098171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:43.098507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:43.099264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:43.133630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2341-fa6f-4ad2-9eb2-1801c4b8b94b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:43.208410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 374/747] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:05:43 2021] POST /identity/v3/services => generated 242 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:45.195091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f0f1-0e15-4a33-b927-012aafa0c55e None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.195605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f0f1-0e15-4a33-b927-012aafa0c55e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.195750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480f0f1-0e15-4a33-b927-012aafa0c55e None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.197580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 374/748] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:45.203319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.203675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.204017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.227863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:45.229064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:45.247628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 375/749] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:45 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:45.269435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.269782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.270149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.293260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:45.294477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:45.302148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 375/750] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:45 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:45.307563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:45.317168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f66a-180f-4271-877a-abb1514b26a7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:45.321324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:45.322154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.322494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.322827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] PATH_INFO: `/v3/services/image` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.323529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:45.352480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:45.363683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 12:05:45.364816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 376/751] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Aug 21 12:05:45 2021] GET /identity/v3/services/image => generated 86 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:45.370886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:45.379767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4f35c-9540-425e-956c-ddd9acf15ce1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:45.383943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:45.384587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.384924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.385257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.386026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:45.386375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:45.415237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:45.419915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 376/752] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:45 2021] GET /identity/v3/services?name=image => generated 122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:45.425436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:45.434754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5281f-ceb3-4ac4-98aa-c28f51957cec admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:45.439162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:45.439791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.440128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.440460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.441198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] RBAC: Adding query filter params (type=image) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:45.441548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:45.470281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:45.475185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 377/753] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:45 2021] GET /identity/v3/services?type=image => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:45.480672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:45.490046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078ac6a-27c5-4c12-b461-d097c06b3dc7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:45.494647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:45.495272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.495608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.495940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.496759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] RBAC: Adding query filter params (interface=public, service_id=292f352186494cd69df618218e9a21ea, region_id=RegionOne) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:45.497123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:45.525261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae195c-aa2b-4f51-83f9-a135d212598f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:45.531157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 377/754] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:05:45 2021] GET /identity/v3/endpoints?service_id=292f352186494cd69df618218e9a21ea&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:45.536572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:45.546075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3e812-5b17-45ec-b1b7-bbe1b0d1251d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:45.550242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:45.550876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:45.551214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:45.551547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:45.552265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:45.580676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f60bb9-42a3-4ddd-9172-6e5e1973af00 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:45.586352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 378/755] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:05:45 2021] GET /identity/v3/services => generated 1022 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:05:47.539276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58f0e-68ac-4d2d-be9c-89ee584e7c71 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.539824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58f0e-68ac-4d2d-be9c-89ee584e7c71 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.539915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b58f0e-68ac-4d2d-be9c-89ee584e7c71 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.541739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 378/756] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:47.547957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.548307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.548647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.574028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:47.575223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:47.582785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 379/757] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:47 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:47.604671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.605020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.605354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.628655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:47.629870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:47.636821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 379/758] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:47 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:47.642811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:47.652160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a96e6-26ba-4089-83bd-cb25e210411d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:47.656963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:47.657752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.658136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.658466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.659160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:47.687502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:47.698617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 12:05:47.699826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 380/759] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Aug 21 12:05:47 2021] GET /identity/v3/services/image => generated 86 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:47.706364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:47.715287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cccc6d-2ecd-461b-b42d-9495e0e2ebff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:47.720176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:47.720822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.721202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.721536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.722320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] RBAC: Adding query filter params (name=image) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:47.722671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:47.750503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:47.755201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 380/760] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:47 2021] GET /identity/v3/services?name=image => generated 122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:47.760502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:47.770523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d4b3d-9bfd-465a-b151-c2987e6172c5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:47.774684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:47.775312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.775649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.775981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.776722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] RBAC: Adding query filter params (type=image) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:47.777070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:47.805373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403498c5-ee89-4f9d-b5af-22b2395a6aba admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:47.810470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 381/761] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:47 2021] GET /identity/v3/services?type=image => generated 350 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:47.815739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:47.825150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd48e3-265a-4bc6-a201-7adb057f8e8d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:47.829842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:47.830437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:47.830773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:47.831104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:47.831858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:47.860011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc0bb48-62e2-4446-90eb-80be0d6f073e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:47.905799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 381/762] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:05:47 2021] POST /identity/v3/endpoints => generated 327 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:49.872248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b709a-ea9d-4510-b020-707f529f676f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:49.872791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b709a-ea9d-4510-b020-707f529f676f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:49.872882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b709a-ea9d-4510-b020-707f529f676f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:49.875327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 382/763] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:49.880659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:49.881010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:49.881345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:49.906406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:49.907607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:49.924808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 382/764] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:49 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:49.946586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:49.946924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:49.947252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:49.970416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:49.971608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:49.978747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 383/765] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:49 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:49.985004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:49.994547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4cd8a-856c-484d-b769-a44b125b6933 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:49.999411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:50.000049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:50.000387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:50.000717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:50.008735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:50.036441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b656b-569e-470b-b1b8-ed17a130b4bc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:50.045699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 383/766] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:49 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:50.051473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:50.060752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c1b26-14d9-4dac-8484-9b18218afbff None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:50.065570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:50.066426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:50.066767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:50.067100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:50.068256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:50.096125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1cd67-53a7-4753-a406-f392d11b2248 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:50.097675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 384/767] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:52.132036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daf44-299c-4799-9fee-5900e4dcb5d8 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.132547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daf44-299c-4799-9fee-5900e4dcb5d8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.132688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736daf44-299c-4799-9fee-5900e4dcb5d8 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.134565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 384/768] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:52.140531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.140883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.141218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.164972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:52.166205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:52.173223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 385/769] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:52 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:52.195215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.195561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.195896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.219985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:52.221178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:52.228238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 385/770] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:52 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:52.233671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:52.243149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c57e0-2a15-4e84-bd8b-37c8a2d22032 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:52.247338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:52.248075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.248411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.248736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.260655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:52.289728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:52.307547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:52.308689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 386/771] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:52.315188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:52.324124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4c63b-0585-4bde-9af1-bdb6392dc619 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:52.328862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:52.329513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.329876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.330211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.330981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:52.331332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:52.359893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd78dce1-a01a-4b5c-a0be-4e37654762a6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:52.373016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 386/772] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:52.378714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:52.388358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9495245-5a1c-45a3-8808-287a72be3cd1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:52.392978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:52.393633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:52.393996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:52.394331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:52.395047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:52.423651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1970d-371b-44c4-a299-641869f02b62 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:52.476239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 387/773] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:05:52 2021] POST /identity/v3/users => generated 248 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:05:54.480279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45cbf-06a2-4b38-83ba-9c8e5a992b6a None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.480848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45cbf-06a2-4b38-83ba-9c8e5a992b6a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.480979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c45cbf-06a2-4b38-83ba-9c8e5a992b6a None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.482817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 387/774] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:54.488224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.488570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.488904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.512191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:54.513382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:54.520865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 388/775] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:54 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:54.543266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.543614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.543950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.566848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:54.568048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:54.575096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 388/776] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:54 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:54.580964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.590398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19da5d8-9729-48ac-b914-6288f1463468 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.595209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.596008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.596345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.596672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.608319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:54.615670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:54.616833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 389/777] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:54.622808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.631633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0fe3e-1ea3-47bb-b40f-4b7ed8db9404 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.635825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.636465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.636805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.637138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.637958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:54.638310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:54.667473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:54.676216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 389/778] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:54.681493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.692120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8a2fd-78c4-4310-ac84-255e69ebfc3c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.696272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.697025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.697365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.697698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.709869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:54.737947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:54.757033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:54.758192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 390/779] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:54.763701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.773812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57580f-9454-4d38-97b7-b6104ee54b49 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.777982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.778617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.778951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.779280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.780038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:54.780383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:54.807885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:54.821541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 390/780] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:54.827503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.836946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1200fc-9cb7-4fa6-a753-6c6681b30e3c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.841115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.841913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.842253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.842585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.855717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:54.884486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:54.904105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 12:05:54.905286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 391/781] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:54.910883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:54.920532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7907c34-cc48-4c7d-b50e-25bc4274b5a3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:54.924741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:54.925393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:54.925731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:54.926108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:54.926991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:54.927348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:54.956799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:54.987446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 391/782] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:54.993422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.003756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222442b-968c-40df-84f1-52383682f187 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.007987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.008630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.008969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.009302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.018065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.046541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.055449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 392/783] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:05:54 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:05:55.062072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.071674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff13540-2619-4b75-a99e-1970d98884be admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.075846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.076662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.076998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.077327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.089199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.117563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.135870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:55.137008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 392/784] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:55.142665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.151507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36aab4-85e9-49da-9a02-a686e3992641 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.155757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.156431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.156774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.157111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.157906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:55.158258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.187344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.200611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 393/785] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:55.205869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.215255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d83b0-d90a-47a1-bb0a-dad77660d56c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.219405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.220159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.220493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.220825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.229782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.258904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.273350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:55.274489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 393/786] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:55.279973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.289457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847c19a-c1df-4f13-958f-0e0d8e5f22bc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.293607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.294271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.294605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.295415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.296242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:55.296595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.325414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f1e7f-b226-435c-b622-15430bf9f0ef admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.338718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 394/787] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:55.344426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:55.353977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881580e-90c4-4ad9-adc9-4c611cfd60ff admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:55.358651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:55.359271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:55.359602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:55.359928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:55.360786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=8c3cbfabf9954b87b9a13bf68684d0fb) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:55.361140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:55.389495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b79df9-2847-460e-80b4-a65d902166cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:55.395043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 394/788] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:05:55 2021] GET /identity/v3/role_assignments?user.id=8c3cbfabf9954b87b9a13bf68684d0fb&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:57.350111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7abd8-9e2a-43cf-9d17-184914da2a3c None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.350621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7abd8-9e2a-43cf-9d17-184914da2a3c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.350711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7abd8-9e2a-43cf-9d17-184914da2a3c None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.352493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 395/789] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:05:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:05:57.358117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.358469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.358807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.382093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:57.383300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:57.390836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 395/790] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:57 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:57.412790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.413132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.413466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.436087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:05:57.437250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:05:57.444211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 396/791] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:05:57 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:05:57.449621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.459552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d910959-0670-4cc7-b8f6-ff2609880c31 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.463756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.464550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.464886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.465219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.477425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:05:57.484854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:05:57.486036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 396/792] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:57.492029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.501296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc859-b3cd-4faa-80df-428d9d3ea0f8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.505470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.506137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.506474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.506803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.507588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:57.507936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.536926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.545603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 397/793] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:57.551089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.561613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c664152-876e-4aa3-b671-8a1aa98de25c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.566025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.566810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.567149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.567481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.579676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.608469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.627149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:57.628293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 397/794] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:57.633988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.644125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eca2ee-75bc-4395-b050-be489c60bd97 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.648314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.648962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.649300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.649629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.650436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:57.650787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.679164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.694884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 398/795] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:57.700207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.710414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c9e3-586a-4245-be30-9cb7a523ae68 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.714648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.715423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.715763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.716099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.731677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.760668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.780432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 12:05:57.781579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 398/796] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/users/cinder => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:57.787367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.797101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707c162-8c50-4526-83f9-110261d406c5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.801317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.802031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.802374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.802709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.803601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:57.803962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.833403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.863921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 399/797] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:57.869484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.879717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588f35-2b42-4ef7-9f9c-c54bc358fae1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.883924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.884713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.885050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.885381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.898419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.926231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:57.944757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:05:57.945915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 399/798] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:57.951973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:57.961482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce3e6-3b15-48da-beb9-e7398c73e79e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:57.965672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:57.966365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:57.966703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:57.967032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:57.967797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:57.968147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:57.996076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:58.009229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 400/799] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:05:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:58.015711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:58.025442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ddee-0f19-4df1-a2ec-2ae00fc63fa1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:58.029655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:58.030472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:58.030809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:58.031139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:58.040276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:58.070288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:58.085021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:05:58.086205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 400/800] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:05:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:05:58.092126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:58.102019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b22fb6-99a8-4a18-8cf3-3a8a4ed923d9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:58.106261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:58.106920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:58.107262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:58.108087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:58.108929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:05:58.109288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:58.138280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fadc65-22d0-426e-b3aa-dd86d20b0387 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:58.151844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 401/801] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:05:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:05:58.157870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:05:58.167560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa0238-1198-4f7a-a3d4-b827b69c959d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:05:58.172258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:05:58.173147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:05:58.173484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:05:58.173825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/8c3cbfabf9954b87b9a13bf68684d0fb/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:05:58.195191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=8c3cbfabf9954b87b9a13bf68684d0fb, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:05:58.224097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60509d-44dd-4800-bc05-5f942a6f704f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:05:58.270660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 401/802] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:05:58 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/8c3cbfabf9954b87b9a13bf68684d0fb/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:06:00.210647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f661-74ab-4a26-a53d-08c43d46d4a5 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.211188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f661-74ab-4a26-a53d-08c43d46d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.211287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157f661-74ab-4a26-a53d-08c43d46d4a5 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.213131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 402/803] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:00.218986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.219335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.219669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.243506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:00.244718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:00.310617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 402/804] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:00 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:00.333236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.333586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.333960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.359035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:00.361138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:00.369901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 403/805] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:00 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:00.375912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.385639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853e975-43bc-4389-ba83-a88a04b0d57d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.390411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.391217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.391555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.391884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.403495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:06:00.411463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:06:00.412623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 403/806] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:00.418848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.427949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d741e2-057a-4d4e-ba1e-75c1c18d8efa None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.432250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.432908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.433249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.433585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.434414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:00.435021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.463512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.472911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 404/807] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:00.478474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.488539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fdabe-bd07-49e2-9580-ecca63c6dc93 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.492700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.493982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.494319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.494645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.506148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.535342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.553760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:00.554922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 404/808] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:00.560867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.570414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e45cc-fbf6-43dd-9fe4-9400ad7b7473 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.574634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.575275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.575615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.575948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.577208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:00.577560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.606039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.619152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 405/809] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:00.624427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.633939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f8556-75a6-4b02-bb64-ca372982daf6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.638078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.639339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.639669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.639993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.653035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.681750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.702176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 12:06:00.703315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 405/810] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:00.708888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.718566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f45213-28d1-4b25-b87d-a3d41c82d9ee admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.722817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.723475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.723816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.724151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.725041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:00.725397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.754093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.784757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 406/811] 10.222.0.18 () {56 vars in 1149 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:00.790386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.800014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75628e-1bd9-446b-b624-38c8d36c105f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.804156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.804788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.805125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.805455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.815148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.843406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.852126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 406/812] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:06:00.857593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.867114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be957ad6-7d11-4f16-936e-890ee63945d5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.871325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.872111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.872451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.872784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.886710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.915251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.933190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:00.934371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 407/813] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:00.940738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:00.949644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36da-228f-4b24-bfa5-853a77c54e78 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:00.954444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:00.955093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:00.955430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:00.955764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:00.956551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:00.956896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:00.984706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:00.997328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:01.003660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:01.013393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bca643-e690-4b27-982b-3b6f6fa32d5d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:01.018208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:01.019006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:01.019342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:01.019675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:01.028821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:01.057484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:01.073076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:06:01.074278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 408/815] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:01.079983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:01.089589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0690d6-d120-46fc-ac88-3359e444f961 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:01.093750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:01.094444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:01.094780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:01.095112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:01.095938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:01.096288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:01.125383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3e3fd-3f5d-4bf7-b2fe-77f38a6fa510 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:01.138657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:06:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:01.144456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:01.154054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be307510-b1c3-48b8-b565-261210615c5f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:01.158242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:01.158875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:01.159213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:01.159542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:01.160415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=8c3cbfabf9954b87b9a13bf68684d0fb) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:01.160773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:01.190136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa07b94-8b73-4c34-828c-1941c4c081f3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:01.196124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 409/817] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:06:01 2021] GET /identity/v3/role_assignments?user.id=8c3cbfabf9954b87b9a13bf68684d0fb&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:03.182641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07c59-6d11-491d-9e0c-e40cc71bdb57 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.183172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07c59-6d11-491d-9e0c-e40cc71bdb57 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.183280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c07c59-6d11-491d-9e0c-e40cc71bdb57 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.185993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 409/818] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:03.191347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.191706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.192047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.216105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:03.217311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:03.224450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 410/819] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:03 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:03.245718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.246161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.246450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.272482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:03.273664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:03.280618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 410/820] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:03 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:03.286323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:03.296796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11400e55-3f5a-473c-9ac9-6ba18d08f314 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:03.301065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:03.302353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.302933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.303503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.304780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:03.334351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:03.348696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 12:06:03.349912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1141 bytes} [Sat Aug 21 12:06:03 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:03.356585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:03.366173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1342f3-4b15-458d-897f-9998a6baa034 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:03.370341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:03.370995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.371329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.371656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.372403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:03.372750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:03.400898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d87c-9da1-4de2-a0a0-cfb7a3545aa9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:03.405607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 411/822] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:03 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:03.410992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:03.421062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def38768-421d-4966-be36-eb3fed0da629 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:03.425287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:03.425961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:03.426304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:03.426638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:03.427391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:03.427744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:03.456396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94870-188e-4c8a-8130-796f2fdcd7aa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:03.460866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:03 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:05.404846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1143-5f3d-4d6c-b692-4a38a32ab53e None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:05.405357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1143-5f3d-4d6c-b692-4a38a32ab53e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:05.405507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1143-5f3d-4d6c-b692-4a38a32ab53e None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:05.407362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 412/824] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:05.412670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:05.413018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:05.413358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:05.437661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:05.438883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:05.445902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 413/825] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:05 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:05.467796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de31c-2aae-4b10-a43f-102bdabfb7f1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:05.468140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de31c-2aae-4b10-a43f-102bdabfb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:05.468472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61de31c-2aae-4b10-a43f-102bdabfb7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:05.491844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e61de31c-2aae-4b10-a43f-102bdabfb7f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:05.493022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e61de31c-2aae-4b10-a43f-102bdabfb7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:05.500456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 413/826] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:05 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:05.505877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:05.515254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524dcb-dc1d-4a56-bb04-0eb6ddbdce1f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:05.519455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:05.520110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:05.520451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:05.520788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:05.521541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:05.550494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbef60-8bd1-4d6a-8d1f-9d03eaf5f2b4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:05.590582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 414/827] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:06:05 2021] POST /identity/v3/services => generated 251 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:07.565195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a5df-6697-4fbf-befa-562db8f36547 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.565740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a5df-6697-4fbf-befa-562db8f36547 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.565869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029a5df-6697-4fbf-befa-562db8f36547 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.567694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 414/828] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:07.573310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.573667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.574034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.599763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:07.600974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:07.617776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 415/829] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:07 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:07.640410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.640752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.641113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.663715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:07.664898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:07.671826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 415/830] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:07 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:07.677263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:07.687354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceaf1ff-c807-46bf-96eb-0e37633b9102 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:07.691537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:07.692345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.692684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.693016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.693708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:07.722144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:07.733853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 12:06:07.734990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 416/831] 10.222.0.18 () {56 vars in 1141 bytes} [Sat Aug 21 12:06:07 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:07.741169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:07.750643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c40fd-19c7-411e-8483-0907379822db None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:07.754848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:07.755492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.755828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.756160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.756905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:07.757251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:07.785462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:07.790267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 416/832] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:07 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:07.796316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:07.805741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d150f0-3750-4a0a-9537-3e31a328adff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:07.810751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:07.811397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.811731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.812060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.812797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:07.813142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:07.840608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:07.845400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 417/833] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:07 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:07.851689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:07.861456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033355-4043-47f5-997f-49d4f6f35d3d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:07.865630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:07.866285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.866623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.866953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.867773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] RBAC: Adding query filter params (interface=public, service_id=30c0c7d9419844d8af8277f37b185226, region_id=RegionOne) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:07.868127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:07.896041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9014d8-ee3a-45da-826f-eb099a619421 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:07.901379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 417/834] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:06:07 2021] GET /identity/v3/endpoints?service_id=30c0c7d9419844d8af8277f37b185226&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:07.906874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:07.916286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362e623-e657-4805-9137-15fbddea22f4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:07.921109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:07.921742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:07.922111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:07.922442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:07.923154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:07.951595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6667b-8242-4382-aeb7-a3b9f4a533c6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:07.957573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 418/835] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:06:07 2021] GET /identity/v3/services => generated 1261 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:06:09.910275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300597-adbb-4a98-8c59-52ffe305d77c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:09.910795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300597-adbb-4a98-8c59-52ffe305d77c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:09.910920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63300597-adbb-4a98-8c59-52ffe305d77c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:09.912707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 418/836] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:09.918350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:09.918704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:09.919044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.015654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:10.016864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:10.023942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 419/837] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:09 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:10.047727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:10.048078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:10.048418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.071829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:10.073032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:10.080656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 419/838] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:10 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:10.086122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:10.096111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19829d2f-f703-42cd-902c-d650e9fd373e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:10.100354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:10.101162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:10.101502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:10.101859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.102562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:10.130121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:10.142187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 12:06:10.143321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 420/839] 10.222.0.18 () {56 vars in 1141 bytes} [Sat Aug 21 12:06:10 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:10.149495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:10.159048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb6f85f-8fe4-400b-956b-39148c8fbdc5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:10.163360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:10.163961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:10.164295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:10.164624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.165376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:10.165722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:10.193427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:10.198322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 420/840] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:10 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:10.204112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:10.213491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457f1d5-eb90-4026-b70f-180745c156e8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:10.218261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:10.218892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:10.219228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:10.219559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.220297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:10.220647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:10.248226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9b4cb-91cc-4d0d-946b-a21245590e29 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:10.253056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 421/841] 10.222.0.18 () {56 vars in 1136 bytes} [Sat Aug 21 12:06:10 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:10.258360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:10.268317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3add27-2842-4265-bed5-0294f7a16ff6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:10.272585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:10.273214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:10.273555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:10.273920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:10.274683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:10.302838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b9a81-241c-4596-8c0f-7c17110a1ddb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:10.395164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 421/842] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:06:10 2021] POST /identity/v3/endpoints => generated 346 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:12.380390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304aa7-a8de-449c-82f9-ffff738c9a9c None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.380921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304aa7-a8de-449c-82f9-ffff738c9a9c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.381032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65304aa7-a8de-449c-82f9-ffff738c9a9c None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.382855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 422/843] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:12.388730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.389223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.389684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.414439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:12.415669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:12.433391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 422/844] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:12 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:12.455875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.456221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.456551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.480245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:12.481436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:12.489572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 423/845] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:12 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:12.495200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:12.504712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35355a7b-a6e5-4dd7-985d-322dbdf9eb12 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:12.508954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:12.509762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.510155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.510493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.511192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:12.540080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:12.551542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 21 12:06:12.552758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 423/846] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:12 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:12.558822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:12.567898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49f28d-1885-47bb-beed-4a0583409487 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:12.572097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:12.572739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.573078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.573408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.574189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:12.574538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:12.603066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28926682-21ad-4dc6-8c37-82c762abfd29 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:12.607872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:12 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:12.613100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:12.622530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50f7f1-3b21-4431-985e-9b70afbdde6f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:12.626730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:12.627363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:12.627703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:12.628038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:12.628775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:12.629122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:12.658059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a14d9-a8f6-42c8-95ce-c82dd428dc36 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:12.662506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 424/848] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:12 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:14.645626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880811-6eca-47e6-8f77-109303e309c9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:14.646200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880811-6eca-47e6-8f77-109303e309c9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:14.646308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880811-6eca-47e6-8f77-109303e309c9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:14.648129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 425/849] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:14.653700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:14.654662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:14.654998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:14.678279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:14.679480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:14.686761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 425/850] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:14 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:14.708780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624cd43-477e-4904-a0c7-a57a955a9e05 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:14.709120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624cd43-477e-4904-a0c7-a57a955a9e05 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:14.709450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624cd43-477e-4904-a0c7-a57a955a9e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:14.732816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d624cd43-477e-4904-a0c7-a57a955a9e05 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:14.734030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d624cd43-477e-4904-a0c7-a57a955a9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:14.740984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 426/851] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:14 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:14.746610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:14.755953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424e357-230f-4c50-afe5-ef60cf90c646 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:14.760154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:14.760802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:14.761136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:14.761460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:14.762235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:14.791262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c71f17-bbbe-430b-9a26-c0ceb73bf3de admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:14.860119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 426/852] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:06:14 2021] POST /identity/v3/services => generated 251 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:16.845133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a040c-40c2-4b1e-bee7-d85a86a5f269 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:16.845682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a040c-40c2-4b1e-bee7-d85a86a5f269 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:16.845773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a040c-40c2-4b1e-bee7-d85a86a5f269 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:16.847631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 427/853] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:16.853129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:16.853480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:16.853838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:16.877285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:16.878522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:16.896201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 427/854] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:16 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:16.918551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:16.918900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:16.919243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:16.942018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:16.943205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:16.950328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 428/855] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:16 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:16.956363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:16.965922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57171423-56c7-4c24-8474-684d0f4af26c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:16.970814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:16.971628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:16.971972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:16.972304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:16.973008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:17.000961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:17.012672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 21 12:06:17.014374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 428/856] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:16 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:17.020981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:17.030806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf163-c75b-4c9a-8ca4-84ba131255dc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:17.035125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:17.035790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:17.036133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:17.036472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:17.037232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:17.037587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:17.069529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:17.075119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 429/857] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:17 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:17.081816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:17.092332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc72a8d-fb1e-43d3-b03a-d9891b9fba81 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:17.096760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:17.097373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:17.097711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:17.098071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:17.098827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:17.099181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:17.126868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:17.131824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 429/858] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:17 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:17.137558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:17.147832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78956768-8e27-4571-8a31-c43218965c4b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:17.152156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:17.152803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:17.153142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:17.153477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:17.154919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] RBAC: Adding query filter params (interface=public, service_id=73542464cdd74c62ae37c08f0acf35d6, region_id=RegionOne) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:17.155283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:17.182795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f27d35-9a98-4123-83a8-91ceb82cf6f8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:17.188920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 430/859] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:06:17 2021] GET /identity/v3/endpoints?service_id=73542464cdd74c62ae37c08f0acf35d6&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:17.194486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:17.204743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49988ac-2b00-45ca-a452-c531364fdc73 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:17.209072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:17.209713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:17.210086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:17.210423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:17.211143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:17.238920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39207f-555e-4ca0-8392-c7a745862d3c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:17.245170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 430/860] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:06:17 2021] GET /identity/v3/services => generated 1500 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:06:19.194848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779e1d-8607-4a43-892f-a95fde1e6609 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.195349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779e1d-8607-4a43-892f-a95fde1e6609 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.195504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779e1d-8607-4a43-892f-a95fde1e6609 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.197345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 431/861] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:19.202799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.203153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.203491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.226853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:19.228050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:19.235920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 431/862] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:19 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:19.257882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.258195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.258528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.281429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:19.282631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:19.289575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 432/863] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:19 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:19.295649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:19.305085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6fdbb-f79e-42e2-bb19-e501bc92e7ff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:19.309332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:19.310988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.311326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.311661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.312358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:19.340183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:19.351664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Aug 21 12:06:19.352886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 432/864] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:19 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:19.359486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:19.368271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc63706-64b0-4dc1-bc0b-ab7bd4d7a67c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:19.373072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:19.373709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.374069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.374401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.375150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:19.375497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:19.403342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:19.408634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 433/865] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:19 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:19.414120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:19.424223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f531cd8-48da-4beb-b50d-39951e1bca97 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:19.428481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:19.429119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.429460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.429823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.430560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:19.430912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:19.458929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74bdd-bee9-40d7-bceb-00a6a11742cb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:19.463883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 433/866] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:19 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:19.469628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:19.479204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c51c1-0dba-4801-abc4-37957f92166f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:19.484041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:19.484668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:19.485007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:19.485340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:19.486134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:19.514340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e5a15-763d-4b73-9d80-4cb588fd4ec2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:19.562415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 434/867] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:06:19 2021] POST /identity/v3/endpoints => generated 346 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:21.523904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c19b0-6e98-4b27-9809-78e667e80f3c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.524421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c19b0-6e98-4b27-9809-78e667e80f3c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.524543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c19b0-6e98-4b27-9809-78e667e80f3c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.526395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 434/868] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:21.532341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.532689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.533025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.556191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:21.557395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:21.574909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 435/869] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:21 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:21.597408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.597751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.598131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.621093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:21.622303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:21.629315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 435/870] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:21 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:21.634753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:21.644573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4779d-a358-432f-8a63-0d40c3c149b2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:21.648794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:21.649598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.649967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.650300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.650998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:21.679318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:21.691421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 12:06:21.692563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 436/871] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:21.698571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:21.707955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07551bf5-dcda-43dd-9b73-16cf5dab9a4b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:21.712170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:21.712815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.713151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.713480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.714252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:21.714603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:21.742656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586be21-9e7d-4f0f-98c0-9620b0664aa6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:21.748052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 436/872] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:21.753487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:21.763640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe0415-7b89-4b3d-891c-292747d57155 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:21.767915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:21.768549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:21.768887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:21.769221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:21.769996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:21.770387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:21.798086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd48f45-3944-4a41-b1f0-e3273564ba3d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:21.802546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 437/873] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:21 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:23.739537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1178b5-b814-4753-890f-5d0135473a13 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:23.740055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1178b5-b814-4753-890f-5d0135473a13 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:23.740230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1178b5-b814-4753-890f-5d0135473a13 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:23.742128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 437/874] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:23.748225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:23.748577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:23.748915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:23.772427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:23.773653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:23.781001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 438/875] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:23 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:23.803349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d02fc-4ca7-49e4-91cc-8d00fe82d3b4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:23.803702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d02fc-4ca7-49e4-91cc-8d00fe82d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:23.804040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d02fc-4ca7-49e4-91cc-8d00fe82d3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:23.828258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-470d02fc-4ca7-49e4-91cc-8d00fe82d3b4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:23.829476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-470d02fc-4ca7-49e4-91cc-8d00fe82d3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:23.836700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 438/876] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:23 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:23.842394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:23.851930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef9467-3bb9-4ada-b0c5-f62a8d69b21a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:23.856162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:23.857316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:23.857656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:23.858039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:23.858798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:23.887315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc5a4-193b-4d23-b0c4-474d0d44c36c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:23.923024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 439/877] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:06:23 2021] POST /identity/v3/services => generated 251 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:25.891791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbd25-5837-4b2e-bf63-aef42d454836 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:25.892290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbd25-5837-4b2e-bf63-aef42d454836 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:25.892444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abbd25-5837-4b2e-bf63-aef42d454836 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:25.894352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 439/878] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:25.900071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:25.900425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:25.900761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:25.924635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:25.925856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:25.943351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 440/879] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:25 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:25.965197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:25.965548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:25.966556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:25.989282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:25.990555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:25.997643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 440/880] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:25 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:26.003581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:26.013561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58863b-cf5e-4c6e-9426-8db815fc597b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:26.017766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:26.018603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:26.018940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:26.019268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:26.019964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:26.048309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:26.059907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 12:06:26.061049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 441/881] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:26 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:26.067420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:26.076949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a44c-40c8-467e-bf95-0848760f01f4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:26.081211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:26.081884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:26.082221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:26.082549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:26.083301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:26.083649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:26.112067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:26.117096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 441/882] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:26 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:26.122557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:26.132109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c44986-92db-460c-ae5b-34bd95899bce admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:26.136357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:26.136997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:26.137334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:26.137663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:26.138936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:26.139286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:26.167561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:26.172441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 442/883] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:26 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:26.178085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:26.188320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e2d5-5723-448f-bf75-3534d8c9a48e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:26.192622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:26.193251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:26.193606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:26.193964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:26.194795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] RBAC: Adding query filter params (interface=public, service_id=4eee721bbfac48ba885d1e936cf2bfea, region_id=RegionOne) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:26.195152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:26.223697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d06a-7f6a-4a83-9277-3ff3913be95d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:26.229151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 442/884] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:06:26 2021] GET /identity/v3/endpoints?service_id=4eee721bbfac48ba885d1e936cf2bfea&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:26.234579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:26.243949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b90e3-9ec8-44fe-ba0e-0a32a2799123 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:26.248697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:26.249323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:26.249657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:26.250016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:26.250725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:26.279021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef117b-c812-4ed7-be02-e593a510d981 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:26.285557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 443/885] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:06:26 2021] GET /identity/v3/services => generated 1739 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:06:28.238022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588a97-6898-4317-9d77-98d49b9f1043 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.238555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588a97-6898-4317-9d77-98d49b9f1043 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.238670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588a97-6898-4317-9d77-98d49b9f1043 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.240483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 443/886] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:28.246120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.246423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.246759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.270706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:28.271903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:28.279010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 444/887] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:28 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:28.300681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.301031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.301367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.325307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:28.326531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:28.333593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 444/888] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:28 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:28.339341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:28.348848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5458b-03dd-4dab-8c6e-897cb23eb269 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:28.353424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:28.354279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.354625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.354963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.355663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:28.384522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:28.396001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 12:06:28.397148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 445/889] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:28 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:28.403908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:28.412830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08ef24-d6d7-47d8-a616-53db6597e3c4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:28.417090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:28.417736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.418135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.418468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.419805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:28.420155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:28.448198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:28.453269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 445/890] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:28 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:28.458698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:28.468675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3172-a9a9-4f43-a273-1b249bd82769 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:28.472941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:28.473581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.473959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.474299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.475045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:28.475395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:28.504645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673402c2-719d-4c86-82f4-4c70d155b234 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:28.509483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 446/891] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:28 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:28.514907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:28.524398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b6b40-cb17-426e-b63d-61ea9b6c03a6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:28.529159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:28.529804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:28.530168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:28.530502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:28.531262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:28.559782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1835eef-0981-488d-a8c1-fe0176863820 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:28.661839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 446/892] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:06:28 2021] POST /identity/v3/endpoints => generated 346 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:30.623404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b8e4-774a-4b3c-b2bc-0e0cd68e39d3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.623921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b8e4-774a-4b3c-b2bc-0e0cd68e39d3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.624067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3b8e4-774a-4b3c-b2bc-0e0cd68e39d3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.625935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 447/893] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:30.632518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.632872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.633212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.659143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:30.660362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:30.678107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 447/894] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:30 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:30.702371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.702707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.703038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.726414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:30.727603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:30.734784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 448/895] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:30 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:30.740723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:30.750698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9241e67-ee54-471b-b5c4-8af3f8afecde None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:30.754930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:30.755582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.755919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.756248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.756961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:30.785561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:30.787007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.common [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 12:06:30.834384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.sql.core [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'ixu_project_name_domain_id'") Aug 21 12:06:30.834384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 12:06:30.834384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [parameters: {'id': '3ad5bd972ec2467ca1518a0e9fb2868d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 12:06:30.834384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=66163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 21 12:06:30.848440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ad5bd972ec2467ca1518a0e9fb2868d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ad5bd972ec2467ca1518a0e9fb2868d. Aug 21 12:06:30.849735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 448/896] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:06:30 2021] POST /identity/v3/projects => generated 262 bytes in 109 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:30.856560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:30.865803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db498c-afdc-4a39-a1b3-9a41e8a759e8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:30.870183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:30.870985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.871325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.871659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.880518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:30.909508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:30.925004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7aca2dc5-4ebb-48d9-92db-d5bfdd57b1aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:06:30.926189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 449/897] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:30.932402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:30.943248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3c9ef-9f85-4494-a1a9-3bfb3768a6ec admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:30.947485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:30.948140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:30.948475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:30.948803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:30.949603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:30.949981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:30.978918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5589846-fc61-4a73-9e4f-e07ea349a8c6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:30.996572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 449/898] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:30 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:32.989868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49dd1-7052-4c44-9d19-4af3d7ab4559 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:32.990376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49dd1-7052-4c44-9d19-4af3d7ab4559 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:32.990533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49dd1-7052-4c44-9d19-4af3d7ab4559 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:32.992370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 450/899] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:32.998108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:32.998461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:32.998796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:33.022196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:33.023759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:33.031478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 450/900] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:32 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:33.054512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:33.054848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:33.055177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:33.079728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:33.080918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:33.087960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 451/901] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:33 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:33.094085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:33.103479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b00d64-08bb-442e-a8d5-b28fc3f8bc3c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:33.108415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:33.109079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:33.109417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:33.109749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:33.110529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:33.137752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:06:33.137752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:06:33.137752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:06:33.139052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:33.242059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.sql.core [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'domain_id'") Aug 21 12:06:33.242059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 12:06:33.242059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [parameters: {'user_id': '6db4408cdf974ea0ae3f28de81397ba4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 12:06:33.242059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=66163) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 21 12:06:33.248583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 12:06:33.250186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 451/902] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:06:33 2021] POST /identity/v3/users => generated 160 bytes in 157 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:33.256839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:33.266129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d4d76-9cd4-4b75-8646-71f73c327700 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:33.270437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:33.271245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:33.271588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:33.271921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:33.285644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:33.315217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:33.335137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8aa441cd-062f-4825-844b-2908f5fbaa46 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 12:06:33.336330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 452/903] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:06:33 2021] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:06:33.343411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:33.353587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a21a7f-db30-4e27-bc96-926fa9648d74 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:33.357961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:33.358629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:33.358969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:33.359301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:33.360154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:33.360501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:33.389565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ac0e-51cb-4332-ab02-acd3e5544c42 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:33.423209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 452/904] 10.222.0.18 () {56 vars in 1113 bytes} [Sat Aug 21 12:06:33 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:35.467463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45dc1-46e8-4d42-8e20-1714b710df99 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.468003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45dc1-46e8-4d42-8e20-1714b710df99 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.468120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45dc1-46e8-4d42-8e20-1714b710df99 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.469971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 453/905] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:35.475366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.475712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.476044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.500121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:35.501654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:35.508746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 453/906] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:35 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:35.531315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.531658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.531996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.555564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:35.556802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:35.564778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 454/907] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:35 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:35.570287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:35.579618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba183a-9d21-4ebf-a263-102eeca852d3 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:35.583806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:35.584593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.584927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.585254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.597126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:35.626130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:35.643961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:35.645097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 454/908] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:35.651269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:35.660191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ca170-14c0-4958-a809-7b66f69a528f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:35.664431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:35.665081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.665419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.665758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.666576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:35.666928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:35.695852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3975dc4-e9cc-4d66-a754-230da154e381 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:35.708965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 455/909] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:35.714352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:35.723874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70c238-e838-455f-81e4-259afed733c5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:35.728001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:35.728641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:35.728975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:35.729304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:35.730043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:35.759369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96695e-fb23-4821-9b8f-91c7bdaec4f7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:35.909574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 455/910] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:06:35 2021] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:37.906120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b602d7-76de-4c98-8e6a-370378242b58 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:37.906644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b602d7-76de-4c98-8e6a-370378242b58 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:37.906793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b602d7-76de-4c98-8e6a-370378242b58 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:37.908643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 456/911] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:37.914003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:37.914346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:37.914674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:37.938964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:37.940153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:37.947253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 456/912] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:37 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:37.969503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:37.969887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:37.970228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:37.993530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:37.994792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:38.002655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 457/913] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:37 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:38.008519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.018206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c311c-57c8-461f-b932-0d35d0403024 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.022511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.023317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.023658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.023989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.035712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:06:38.043159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:06:38.044817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 457/914] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:38.050899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.060689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c503ed4-d27d-4c19-b2a2-a1c99774ff49 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.064991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.065641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.066010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.066348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.067144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.067497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.095344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.103984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 458/915] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:38.110073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.120028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2198-034f-49e8-9746-698302cdd7ee admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.124939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.125705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.126074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.126408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.138210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.166953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.189250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:38.190422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 458/916] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:38.196317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.206047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573adbe9-fd4a-4600-bd56-abbd737629ae admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.210350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.210999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.211342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.211677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.212446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.212802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.241813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.254846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 459/917] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:38.260441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.270062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b6310-e5e3-40be-a31b-17e03a64eb18 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.274303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.275083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.275415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.275741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.289435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.318460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.337349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 12:06:38.338509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 459/918] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/users/neutron => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:38.344670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.354300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb251b-3e1c-48b4-8582-a902f31cf686 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.359180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.359836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.360171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.360502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.361382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.361734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.389727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.420666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 460/919] 10.222.0.18 () {56 vars in 1151 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:38.426249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.436014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467bbe-59ad-4bc3-90e9-c72b50d25823 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.440215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.440839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.441173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.441501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.449435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.477815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.487228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 460/920] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:06:38.492889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.502949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de31b60-6664-4837-9ef6-aac6d3f6849e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.507479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.508309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.508650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.508987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.520940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.550678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.568885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:38.570143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 461/921] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:38.576170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.585005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8617-5846-4afd-a169-a9b2e7857e26 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.589239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.589914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.590251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.591175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.591928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.592271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.619737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.632859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 461/922] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:38.638836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.648333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865e69c-4fe5-4e85-bbe5-45e4d7f5b879 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.652567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.653965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.654305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.654635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.663679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.692075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.707290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:06:38.708512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 462/923] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:38.714082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.724230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041bd1b-5ebc-4126-afe9-7cf26cab6e39 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.728458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.729105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.729441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.729769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.730635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.730987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.758880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7230a9-f291-432d-ae15-4c3fc8458b63 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.772846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 462/924] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:38.779652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:38.789359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d207f-8a6a-48cb-af22-942f198044c7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:38.793768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:38.794483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:38.794820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:38.795149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:38.796027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=294019491b31446c8f92c072f351de93) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:38.796388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:38.824429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e89cf-f4bb-4e33-868f-08fbd7c06951 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:38.830520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 463/925] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:06:38 2021] GET /identity/v3/role_assignments?user.id=294019491b31446c8f92c072f351de93&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:40.802775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583173-6d99-4068-8ef8-40e2e56c8a04 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:40.803289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583173-6d99-4068-8ef8-40e2e56c8a04 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:40.803433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583173-6d99-4068-8ef8-40e2e56c8a04 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:40.805280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 463/926] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:40.811600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:40.811953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:40.812291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:40.835524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:40.836715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:40.843779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 464/927] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:40 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:06:40.865588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:40.865981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:40.866318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:40.889850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:40.891059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:40.898239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 464/928] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:40 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:40.903859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:40.913187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fe5de-8793-4083-adc3-619a7a120764 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:40.917392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:40.918217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:40.919045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:40.919374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:40.930948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:06:40.939203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:06:40.940347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 465/929] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:40.946480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:40.955316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555d2e3-2fc9-4c19-b1b8-98f87fc1ff4c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:40.959697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:40.960346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:40.960690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:40.961026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:40.961854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:40.962217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:40.990762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.000702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:06:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:41.006540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.016828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c4f81-35c2-4e28-9c91-d91db7b00c30 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.021153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.021972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.022312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.022642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.034220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.063700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.083949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:41.085094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 466/931] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:41.090919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.100621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed89ca-3827-4d61-bc83-f206321d216f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.104960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.105616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.106485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.106829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.107603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:41.107964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.136384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.149575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 466/932] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:41.155434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.165043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a4d72-7e87-4341-a50c-fa60c6d335a8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.169943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.170719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.171059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.171393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.184793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.212963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.232988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 12:06:41.234151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 467/933] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/users/neutron => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:41.239650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.249328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69fe7e-85f7-4e15-928f-348e14d07876 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.253627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.254314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.254658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.254993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.255910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:41.256267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.284826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.316218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1151 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:41.321586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.331204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd34c-9c02-4740-962d-6e41e5cfa847 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.335480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.336249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.336586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.336915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.349767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.378284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.396141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:41.397277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:41.402641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.412620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a73687-f5dd-4c09-9ba4-409381b02d9e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.417285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.417972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.418311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.419235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.420007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:41.420352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.448801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.461898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:41.468192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.477929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f43c0-811d-4ba6-8ee0-bb76ae0a6fd7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.482771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.483561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.483896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.484226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.493659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.521749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.536870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:06:41.538040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:41.544283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.553936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda87253-3b50-42d2-97a6-78bc323e8857 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.558216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.558865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.559486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.559816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.560646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:41.561000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.589612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660f31-263d-4e49-b9b6-a03322b7fdaa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.603680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 469/938] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:06:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:41.609492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:41.619163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940a7bd-9914-452b-af70-815123acdfbb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:41.623447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:41.624330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:41.624668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:41.624999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/294019491b31446c8f92c072f351de93/roles/3de22e2140d249608b449af97da44592` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:41.645922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=294019491b31446c8f92c072f351de93, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:41.675292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bbbce-b152-4990-af4c-94cac04e962e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:41.744903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 470/939] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:06:41 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/294019491b31446c8f92c072f351de93/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:06:43.687006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334e6f-d133-40e9-a3d3-021ecf0ea2df None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.687519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334e6f-d133-40e9-a3d3-021ecf0ea2df None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.687647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334e6f-d133-40e9-a3d3-021ecf0ea2df None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.689471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 470/940] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:43.694950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.695302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.695640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.719516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:43.720720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:43.786396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 471/941] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:43 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:43.808901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.810125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.810468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.833159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:43.834385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:43.841443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 471/942] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:43 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:43.846958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:43.856873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b4645-54b4-46e5-80b2-5d03e4485225 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:43.861141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:43.861975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.862320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.862655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.875046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:06:43.882498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:06:43.883664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 472/943] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:43.889817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:43.898728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599a3ec-e7d5-43e1-9fc1-15666beb49bf None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:43.903012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:43.903665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.904004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.904336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.905129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:43.905478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:43.933812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:43.943495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 472/944] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:06:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:43.948745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:43.959663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fdb6d-f1ab-4183-974e-5dce26c57b44 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:43.963934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:43.964715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:43.965052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:43.965418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:43.977192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.006536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.025347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:44.026560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 473/945] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:44.032548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.042426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a3dd-ea7f-4dbb-829b-fed8513fe41d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.047207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.047868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.048213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.048550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.049333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:44.049685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.078554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.091708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 473/946] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:44.097081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.107175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644b41-ce16-4d68-94c5-0ea94b3e0128 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.111412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.112188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.112527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.112866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.126569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.155318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.175039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 12:06:44.176174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 474/947] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/users/neutron => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:44.181831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.191787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931602-27b0-4678-a289-5f37c09947cb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.196119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.196725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.197068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.197402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.198315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:44.198675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.227364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.260506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 474/948] 10.222.0.18 () {56 vars in 1151 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:06:44.266114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.275634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a749ebf-55a6-457c-9176-74e6aa471ce0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.280359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.280982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.281316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.281643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.290414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.319042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.327799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 475/949] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:06:44.333255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.343403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036180b8-dd0d-46f6-a2e5-4c799353b5de admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.347692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.348474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.348812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.349144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.361730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.389598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.408054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:44.409260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 475/950] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:44.414642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.424013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec26f17-125e-4b7f-9442-33b5ead3d286 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.428350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.428993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.429333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.429667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.430482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:44.430814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.458823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.471723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 476/951] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:44.477061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.487212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b875146-7417-4526-b9be-ec9b83570c85 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.491462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.492235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.492573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.492905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.502508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.530927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.546206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:06:44.547422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 476/952] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:44.553168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.562961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a28ca-ab60-4ac5-912a-30c9729e8bd9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.567200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.567838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.568172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.568500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.569322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:44.569674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.598742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6745ba-5901-444b-ab9e-6196e813634d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.614239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 477/953] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:44.619946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:44.629555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de316a-4209-4757-b205-db9405df4e83 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:44.633824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:44.634474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:44.634812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:44.635144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:44.636015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=294019491b31446c8f92c072f351de93) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:44.636374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:44.665314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1fbc-e61f-41b4-9053-6993d34b86db admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:44.671272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:06:44 2021] GET /identity/v3/role_assignments?user.id=294019491b31446c8f92c072f351de93&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:46.643651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e6d0-9f51-43d2-8bb5-5b5e3976b7b7 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.644167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e6d0-9f51-43d2-8bb5-5b5e3976b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.644313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5e6d0-9f51-43d2-8bb5-5b5e3976b7b7 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.646176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 478/955] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:46.651449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.651801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.652143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.675529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:46.676727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:46.683809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 478/956] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:46 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:46.706269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.706615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.706951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.729389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:46.730609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:46.737642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 479/957] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:46 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:46.743128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:46.753128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e1ff5-c537-4070-b714-0bf1ffbd01a0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:46.757379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:46.758199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.758539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.758870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] PATH_INFO: `/v3/services/network` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.759565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:46.787870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:46.799685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 12:06:46.800894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 479/958] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:46 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:46.806988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:46.816691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabb81-e6b9-46b7-b32f-774a73612c8a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:46.820968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:46.821612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.821978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.822311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.823058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:46.823409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:46.851050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f958-7842-4be2-aa3d-24be5f14bfa5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:46.856508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 480/959] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:46 2021] GET /identity/v3/services?name=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:46.861782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:46.871349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375295e-da7b-40c4-b380-5fc08bc45c0f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:46.876153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:46.876790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:46.877125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:46.877453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:46.878225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:46.878569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:46.906094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677653dd-1c1f-410c-9717-e7b3bc413e47 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:46.910555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 480/960] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:46 2021] GET /identity/v3/services?type=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:48.856356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c0d9-1616-4e93-bbeb-153d930128a2 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:48.856906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c0d9-1616-4e93-bbeb-153d930128a2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:48.857020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c0d9-1616-4e93-bbeb-153d930128a2 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:48.858886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 481/961] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:48.864477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:48.864834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:48.865175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:48.889794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:48.891037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:48.898206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 481/962] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:48 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:48.920097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6b18-9078-435c-8ca4-b6f7e85e2474 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:48.920448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6b18-9078-435c-8ca4-b6f7e85e2474 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:48.920786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce6b18-9078-435c-8ca4-b6f7e85e2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:48.944286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-65ce6b18-9078-435c-8ca4-b6f7e85e2474 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:48.945475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-65ce6b18-9078-435c-8ca4-b6f7e85e2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:48.953185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 482/963] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:48 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:48.959245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:48.968912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae96d8-7921-4299-9b69-9d4961de9243 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:48.973133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:48.973826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:48.974175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:48.974507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:48.975269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:49.003505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61c40-0943-43ae-900f-69b655a4f5b9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:49.106225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 482/964] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:06:48 2021] POST /identity/v3/services => generated 240 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:51.060960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566551f-066a-4a2e-923a-75d641eca962 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.061442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566551f-066a-4a2e-923a-75d641eca962 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.061605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566551f-066a-4a2e-923a-75d641eca962 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.063467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 483/965] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:51.069047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.069394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.069727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.093369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:51.094589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:51.112875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 483/966] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:51 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:51.134132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.134476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.134807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.157760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:51.158976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:51.166012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 484/967] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:51 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:51.172311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:51.181621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3e861-454c-4d1c-9fcc-e155dab345f1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:51.186125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:51.186920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.187258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.187588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.188275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:51.216547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:51.227802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 12:06:51.229002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 484/968] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:51 2021] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:51.235778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:51.244583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940767c6-259e-444c-bc0f-52d75d63b8a5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:51.248868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:51.249462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.249837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.250156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.250904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:51.251251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:51.279339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:51.284384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 485/969] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:51 2021] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:51.289779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:51.299986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ae6c1-ec99-44ef-9a70-bcc90152a4a4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:51.304253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:51.304897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.305238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.305571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.306343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:51.306692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:51.335332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:51.340785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 485/970] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:51 2021] GET /identity/v3/services?type=network => generated 350 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:51.346482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:51.355958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82607a8d-47fb-4950-81cb-40808cfe2bb1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:51.360219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:51.360846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.361183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.361513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.362371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] RBAC: Adding query filter params (interface=public, service_id=474cf9761d8348a7a05bb10382537506, region_id=RegionOne) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:51.362733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:51.390641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cc08b-c08a-4d10-8ff7-7ee9365e90b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:51.395988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 486/971] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:06:51 2021] GET /identity/v3/endpoints?service_id=474cf9761d8348a7a05bb10382537506&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:51.401160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:51.411166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8efe6c-481a-4f42-8706-6fabf7b277a5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:51.415393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:51.416021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:51.416360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:51.416694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:51.417398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:51.445425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42aaf8-8718-43a2-b6dc-d74445b8ed75 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:51.452881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 486/972] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:06:51 2021] GET /identity/v3/services => generated 1967 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:06:53.398106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f142-707c-461f-90ec-3f65d475aa60 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.398598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f142-707c-461f-90ec-3f65d475aa60 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.398760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f142-707c-461f-90ec-3f65d475aa60 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.400596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 487/973] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:53.406184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.406532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.406865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.430039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:53.431233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:53.438838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 487/974] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:53 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:53.461155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.461497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.461857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.485056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:53.486275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:53.493914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 488/975] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:53 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:53.499661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:53.509188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab9d12-c4b2-43ab-b5c8-ab0ea290444b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:53.514060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:53.514856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.515188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.515516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.516209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:53.544530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:53.555852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 12:06:53.557062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 488/976] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:53 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:06:53.563831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:53.572768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97941d8-bfd9-4aa3-a02f-1b07dee66647 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:53.577083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:53.577735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.578105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.578444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.579202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:53.579555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:53.607830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:53.612958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 489/977] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:53 2021] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:53.618369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:53.628346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a5ee9-851f-4014-933e-d58f27d510e1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:53.632575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:53.633205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.633544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.633902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.634643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:53.634989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:53.662695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275fe2fb-fe9b-4c27-84e9-373f7e06eb05 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:53.667453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 489/978] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Aug 21 12:06:53 2021] GET /identity/v3/services?type=network => generated 350 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:53.673417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:53.682977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159afd82-1f57-49ac-8275-15be08de2552 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:53.687942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:53.688576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:53.688920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:53.689254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:53.690044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:53.717706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84f35-4df7-4a71-9865-558559b84e4f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:53.765489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 490/979] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:06:53 2021] POST /identity/v3/endpoints => generated 327 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:06:55.835979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103aa-a877-4ff0-ab73-d73089c818ac None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:55.836566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103aa-a877-4ff0-ab73-d73089c818ac None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:55.836674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103aa-a877-4ff0-ab73-d73089c818ac None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:55.838558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 490/980] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:55.844692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:55.845038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:55.845371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:55.869159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:55.870404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:55.889894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 491/981] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:55.913184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:55.913535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:55.913901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:55.937538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:55.938766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:55.945876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 491/982] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:55.952100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:55.961665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfde58-1076-4288-9efc-520192e324f0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:55.966643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:55.967314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:55.967652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:55.967985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:55.968754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:55.996136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:06:55.996136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:06:55.996136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:06:55.996885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:56.030363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.sql.core [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'ixu_role_name_domain_id'") Aug 21 12:06:56.030363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 12:06:56.030363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [parameters: {'id': 'a982f5e6ff9940f587f533da5617f538', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 12:06:56.030363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: (Background on this error at: http://sqlalche.me/e/gkpj) {{(pid=66162) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Aug 21 12:06:56.043954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 12:06:56.045290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 492/983] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:06:55 2021] POST /identity/v3/roles => generated 144 bytes in 94 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:56.052235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:56.061890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b5f6b-7878-4ef4-8a4e-43eca1f7418d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:56.066224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:56.067040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:56.067379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:56.067711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:56.079878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:06:56.087647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3ca33593-f677-42dd-a966-0c14e52b777c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 12:06:56.088846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 492/984] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Aug 21 12:06:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:56.095244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:56.106482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0d66-7b65-44cd-ba11-6fa0caa63fd8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:56.110807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:56.111462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:56.111801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:56.112134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:56.112929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:56.113283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:56.141526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea225b-5889-4d6b-93f2-1f27af5b823b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:56.150269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 493/985] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:06:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:58.117061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262b86-20e6-4b6d-8e3a-bd1eef3924a4 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.117604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262b86-20e6-4b6d-8e3a-bd1eef3924a4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.117719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a262b86-20e6-4b6d-8e3a-bd1eef3924a4 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.119571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 493/986] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:06:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:06:58.125194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.125547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.125919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.149752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:58.150999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:58.158797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 494/987] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:58.180788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.181139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.181475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.205168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:06:58.206385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:06:58.213430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 494/988] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:06:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:06:58.219695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:58.229112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f88ea6-a1fa-43b5-9cdc-538c5c364603 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:58.233443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:58.234269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.234604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.234933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.246975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:58.275447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:58.294154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:06:58.295339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 495/989] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:06:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:06:58.302196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:58.311597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5ee5f-062a-48b9-8b17-7c466b4ba455 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:58.315975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:58.316632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.316969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.317302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.318148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:06:58.318501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:58.347576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48abee-0cb1-4a60-9408-9dbf1a435c19 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:58.360886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 495/990] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:06:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:06:58.366854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:06:58.376634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5506-2d90-4355-923f-c0ae4a0b4695 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:06:58.380979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368767de-e566-483e-a486-58273dd2564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:06:58.381634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368767de-e566-483e-a486-58273dd2564f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:06:58.382005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368767de-e566-483e-a486-58273dd2564f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:06:58.382338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368767de-e566-483e-a486-58273dd2564f admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:06:58.383060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368767de-e566-483e-a486-58273dd2564f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:06:58.412772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368767de-e566-483e-a486-58273dd2564f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:06:58.459168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 496/991] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:06:58 2021] POST /identity/v3/users => generated 247 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:00.458013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbcb2-1316-48e8-9572-2d28b9ff71ff None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.458528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbcb2-1316-48e8-9572-2d28b9ff71ff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.458696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eacbcb2-1316-48e8-9572-2d28b9ff71ff None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.460501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 496/992] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:00.466150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.466505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.466846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.490128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:00.491334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:00.499842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 497/993] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:00.521705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.522085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.522425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.545713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:00.546927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:00.554112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 497/994] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:00.560383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.569815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eac14f-fe22-422b-bb43-2bf3b70a2ecc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.574092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.574886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.575221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.575551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.587146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:00.594514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:07:00.595840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 498/995] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:00.602184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.611556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a55937-a340-4ef7-afc8-0978d7ca8583 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.615816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.616464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.616800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.617131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.617949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:00.618299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:00.646784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:00.655901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 498/996] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:00.661565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.672542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0452b-4e24-4e76-86cd-9fc4ec4d93dd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.676895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.677697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.678070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.678405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.695723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:00.724560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:00.746165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:00.747361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 499/997] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:00.753623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.763469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840e3a6-a53c-4367-9fa7-206a8a1d4849 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.767705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.768361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.768697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.769028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.769819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:00.770166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:00.799212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:00.812597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 499/998] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:00.818033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.827700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e462a6d-7704-4942-b371-b9d3bf043bfb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.831950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.832716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.833049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.833372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.847037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:00.876470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:00.895389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:00.896550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 500/999] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/users/swift => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:00.903124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.912823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3efa0-eab4-4fb4-933f-5a68388dd444 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:00.917111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:00.917767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:00.918714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:00.919046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:00.919929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:00.920278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:00.948509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:00.982245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 500/1000] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:00.988392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:00.998483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a71afd-b4b7-4c4b-a145-ae37cec22a77 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.002713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.003356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.003694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.004022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.012072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.040407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.049973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 501/1001] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:01.056178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:01.066307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c164a29e-c0d2-40e8-a0b6-72e5a7cef093 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.070638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.071437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.071776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.072108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.084603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.113332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.131275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:01.132418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 501/1002] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:01.138814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:01.147686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a845d7f-5ba4-40b9-afdf-9fb7473e5933 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.151987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.153253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.153583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.153939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.154700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:01.155048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.182653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.195969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 502/1003] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:01.202111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:01.211592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99b3cb-7482-447b-8f4f-b65653658a7d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.216398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.217171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.217503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.217848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.226854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.254890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.270160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:01.271424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 502/1004] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:01.278241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:01.288053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb2a46-58de-43fc-b781-1d161ccf180e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.292314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.292990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.293327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.293656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.294519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:01.294872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.322993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c97d66-417c-41a5-9d83-60ed0983f578 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.336932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 503/1005] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:01.343780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:01.353662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadf19b-09ea-44d9-a2c8-0066760b72e1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:01.358015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:01.358662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:01.359006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:01.359336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:01.360247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=548a40dbc77541399c25dd99e88ec169) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:01.360607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:01.389121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc3144-b554-413f-bc91-d7d6b6c0f8b9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:01.394705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 503/1006] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:01 2021] GET /identity/v3/role_assignments?user.id=548a40dbc77541399c25dd99e88ec169&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:03.345610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c61a0-ee7b-4861-8016-58d46b94e3b8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.346142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c61a0-ee7b-4861-8016-58d46b94e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.346279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c61a0-ee7b-4861-8016-58d46b94e3b8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.348127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 504/1007] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:03.353755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.354146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.354478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.378980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:03.380174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:03.387316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 504/1008] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:03.408960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.409306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.409640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.432812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:03.434639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:03.441796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 505/1009] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:03.447506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.456838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8779c4-dc9e-4736-983d-474e3c8851c2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.461047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.461860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.462199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.462529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.474073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:03.481853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:07:03.483000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 505/1010] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:03.489308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.499202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014223-e35e-4016-ac90-5cc42dfae667 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.503506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.504157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.504498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.504835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.505634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:03.506021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.533810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.542570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 506/1011] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:03.548720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.559846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f74be-4e83-4d28-ab7a-e924756ff3ad admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.564128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.564904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.565243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.565576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.577207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.605751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.624863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:03.626030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 506/1012] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:03.631738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.641322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899056c-9602-45de-9892-963f97bf48e0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.645606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.646298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.646644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.647017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.647783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:03.648134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.676962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.690407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 507/1013] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:03.695883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.705369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef49478-25c4-4bb2-aec4-75922e4b76d1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.709597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.710406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.710738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.711062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.724730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.753578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.772467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:03.773599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 507/1014] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:03.779949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.789501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf72680-8cd0-47df-9c1f-fa8306c4ad39 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.794433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.795081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.795418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.795749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.796649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:03.796979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.824977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.855963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 508/1015] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:03.861513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.871129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc58fb-71b3-4a5b-a7b9-9b925cc53f00 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.875479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.876260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.876598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.876926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.889426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.918527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:03.936700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:03.937858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 508/1016] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:03.943580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:03.953351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e961-e34f-49b7-94a7-cd2078e2e14f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:03.958088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:03.958741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:03.959085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:03.959421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:03.960193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:03.960552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:03.989631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:04.002492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 509/1017] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:04.008503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:04.018345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b260-5eaa-429f-9b7d-3a72ac8c4008 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:04.022573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:04.023366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:04.023703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:04.024028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:04.033802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:04.062770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:04.077925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:04.079072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 509/1018] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:04.084931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:04.095211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b06b2-6f7e-4b8a-a0a2-ab17b9de326b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:04.099538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:04.100183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:04.100525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:04.100860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:04.101696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:04.102088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:04.130335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6be953-d946-4148-b09e-93abb795f3f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:04.144518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 510/1019] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:04.150501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:04.160969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce929d6-de8c-4e26-a072-bc3e106af02a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:04.165228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:04.166164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:04.166499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:04.166834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/548a40dbc77541399c25dd99e88ec169/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:04.187706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=548a40dbc77541399c25dd99e88ec169, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:04.217451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef54074-6606-4107-b1b0-299632fe0517 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:04.268722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 510/1020] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:07:04 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/548a40dbc77541399c25dd99e88ec169/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:07:06.236998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a628-74ca-4fa1-98e4-da3944cba121 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.237503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a628-74ca-4fa1-98e4-da3944cba121 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.237642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226a628-74ca-4fa1-98e4-da3944cba121 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.239517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 511/1021] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:06.245132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8de60-cccf-451c-8494-581024108076 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.245526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8de60-cccf-451c-8494-581024108076 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.246328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8de60-cccf-451c-8494-581024108076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.270415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-68c8de60-cccf-451c-8494-581024108076 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:06.271629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-68c8de60-cccf-451c-8494-581024108076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:06.340557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 511/1022] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:06.363224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.363573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.363913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.387839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:06.389045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:06.396284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 512/1023] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:06.402010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8de60-cccf-451c-8494-581024108076 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.411988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8de60-cccf-451c-8494-581024108076 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.416286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.417084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.417422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.417825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.429446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:06.436972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:07:06.438249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 512/1024] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:06.444333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.454158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b21afa-ddb5-43aa-b34c-c2dda7f8327a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.458566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.459222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.459562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.459894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.460692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:06.461047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.489757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.499098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 513/1025] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:06.504637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.515249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35a9-a0f8-4bf1-934b-75b3eaf9b439 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.519525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.520332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.520670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.521002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.533172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.561516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.580518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:06.581643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 513/1026] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:06.587366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.597597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957c0c-472e-4178-973f-2c97af4d4bce admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.601902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.602548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.602933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.603268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.604036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:06.604386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.632277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.646183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 514/1027] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:06.651671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.661870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db393f56-f1e0-4e08-819c-4d6d6179effe admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.666151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.666923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.667261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.667590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.680774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.710107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.728942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:06.730159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 514/1028] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:06.735968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.745679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a17d6-5d61-4458-a7cd-328d585ab9a4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.750639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.751241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.751579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.751910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.752791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:06.753146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.781814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.814954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 515/1029] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:06.820534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.830836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f73d3-e342-4c92-9732-c46ffb85b556 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.835049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.835734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.836070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.836395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.844457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.872590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.881711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 515/1030] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:06.888025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.897587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339d900-3557-40f9-ab36-439da777173f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.901859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.902647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.903172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.903403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.915237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:06.945533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:06.968652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:06.970021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 516/1031] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:06.978006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:06.987453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374ca7-c739-4e94-b9fb-3d84b632e3ba admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:06.991887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:06.992554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:06.992894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:06.993228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:06.994045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:06.994401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:07.023363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:07.036830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 516/1032] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:07.043467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:07.053433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fb3be-8b11-417d-a8c2-d3a71b69249e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:07.057783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:07.059288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:07.059630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:07.059964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:07.069110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:07.097162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:07.112366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:07.113515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 517/1033] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:07:07.119362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:07.129591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0f69d-a28f-462f-8a28-52ec7e06bfca admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:07.133878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:07.134522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:07.134857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:07.135187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:07.136145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:07.136501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:07.164489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26367ca-5c7e-4ec9-ac0e-e3513438a0c2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:07.178457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 517/1034] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:07.185233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:07.194907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69de5e-1f2f-4501-a429-c1a672bc3251 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:07.199198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:07.199831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:07.200174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:07.200513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:07.201392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=548a40dbc77541399c25dd99e88ec169) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:07.201755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:07.229672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4263d-90f1-42c9-a706-d073958528f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:07.236176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 518/1035] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:07 2021] GET /identity/v3/role_assignments?user.id=548a40dbc77541399c25dd99e88ec169&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:09.235483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ddd-63ad-4a7a-b1df-873906fe0106 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.235989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ddd-63ad-4a7a-b1df-873906fe0106 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.236148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f76ddd-63ad-4a7a-b1df-873906fe0106 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.238028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 518/1036] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:09.243571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.243917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.244249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.267584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:09.268736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:09.275805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 519/1037] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:09.298299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.298645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.298978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.321940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:09.323131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:09.330808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 519/1038] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:09.336382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.346443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc903f-512e-4b78-a513-33183f8f50bc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.350652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.351441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.351776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.352111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.363663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:09.370920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:09.372147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 520/1039] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:09.378256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.387599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d62-b6ee-4935-844b-ab012bcff298 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.391902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.392553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.392890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.393224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.394041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:09.394392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.422870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.431650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 520/1040] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:09.437312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.447414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8a4d9-b5ae-4f73-9b2e-467a5098294e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.452170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.452934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.453270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.453601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.465692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.494168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.513389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:09.514536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 521/1041] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:09.520296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.530507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4498e-38da-433f-a832-10b2878b92b8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.534766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.535408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.535743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.536069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.536826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:09.537169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.565357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.578835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 521/1042] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:09.584336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.594511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95a26-1528-450c-ac55-c3293f8ab464 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.598810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.599579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.599917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.600251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.613469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.642379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.662005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:09.663139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 522/1043] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/users/swift => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:09.668857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.678409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e5ee1-2cec-4b48-ac80-6a126daeb0b8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.682687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.684084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.684418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.684747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.685619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:09.686017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.714719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.744784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 522/1044] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:09.750936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.760649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d731de1-b817-40b9-9899-112c5aeef9e0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.765537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.766227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.766570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.766901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.775855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.803621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.813279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 523/1045] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:09.819067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.829205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b6e04-e5cf-40dd-8d91-96b0d2c8fdb7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.833489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.834298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.834635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.834965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.846997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.875555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.894085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:09.895315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 523/1046] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:09.900966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.909939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd56d93-5574-44ba-a3fb-2c5cf1c90ef8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.914268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.914917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.915261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.915597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.916364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:09.916719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:09.945258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:09.958363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 524/1047] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:09.963864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:09.973560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993e60b-f727-4db5-9c78-e96670245ab4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:09.977883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:09.978668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:09.979003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:09.979330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:09.990507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:10.019592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:10.034195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:10.035306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 524/1048] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:10.041534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:10.051975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff1cc-a819-4671-899b-2a4612f7fab5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:10.056341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:10.056998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:10.057341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:10.057678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:10.059462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:10.059820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:10.087946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f79206-05ac-41e6-91b3-5473d6e50590 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:10.101547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 525/1049] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:10.107788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:10.117468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd5a5-607c-4f6e-85cb-36030279f107 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:10.122356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35191d14-9554-4249-8dad-211181a986be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:10.122996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191d14-9554-4249-8dad-211181a986be admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:10.123335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191d14-9554-4249-8dad-211181a986be admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:10.123669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35191d14-9554-4249-8dad-211181a986be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:10.124545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35191d14-9554-4249-8dad-211181a986be admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=548a40dbc77541399c25dd99e88ec169) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:10.124906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35191d14-9554-4249-8dad-211181a986be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:10.152883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35191d14-9554-4249-8dad-211181a986be admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:10.158484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 525/1050] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:10 2021] GET /identity/v3/role_assignments?user.id=548a40dbc77541399c25dd99e88ec169&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:12.194807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4119-c455-4fda-aa07-e40a43800edb None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.195394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4119-c455-4fda-aa07-e40a43800edb None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.195507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b4119-c455-4fda-aa07-e40a43800edb None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.197297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 526/1051] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:12.202931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.203283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.203621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.227561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:12.228770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:12.236502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 526/1052] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:12.258388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.258678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.259009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.282248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:12.283430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:12.290515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 527/1053] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:12.296927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.306339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebe46c-e38e-4927-8f88-e8727f39dd55 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.310840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.311636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.311977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.312302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.324473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:12.334277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:12.335539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 527/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:12.342808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.351859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93fb71-06f9-45a1-a961-d1dfba87cf5a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.356170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.356833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.357171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.357503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.358324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:12.358675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.386965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.395792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 528/1055] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:12.401399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.412235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159581fe-1fd0-448f-ba66-d6ad4901c488 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.416502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.417271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.417634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.417988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.429464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.458087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.477018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:12.478169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 528/1056] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:12.483879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.493932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca959e37-3dbf-4696-a893-513ed4c27678 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.498197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.498834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.499168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.499495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.500294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:12.500639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.529373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.542391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 529/1057] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:12.547891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.557455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36608390-acff-48e1-848a-a67cc5d7f729 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.562031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.562801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.563135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.563464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.577134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.605803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.624645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:12.625767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 529/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/users/swift => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:12.631586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.641708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd0bf3-6b00-4244-b0a2-fc60cbdab376 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.646065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.646708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.647045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.647374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.648257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:12.648611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.677514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.711170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 530/1059] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:12.716953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.726766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f314809-dd74-4a63-b27d-948241fd118e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.731151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.731936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.732275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.732608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.745232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.774444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.792527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:12.793721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 530/1060] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:12.799347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.809664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ebd4c-1a0c-4862-af44-2bdf393734db admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.813928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.814574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.814914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.815247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.816014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:12.816363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.844603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.856918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 531/1061] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:12.862453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.872550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2035-ea4d-4f10-81a0-8db1e3911913 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.876819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.877600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.877972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.878351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.888166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.916318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.931184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:12.932405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 531/1062] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:12.938776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:12.948284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389ad52-b746-439d-b469-90328f5b88ce admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:12.953102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:12.953739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:12.954105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:12.954437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:12.955263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:12.955615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:12.983570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415e4bd-b7fd-4964-aa5b-fe63be58b2c0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:12.997804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 532/1063] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:13.004077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:13.014569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e3db-3547-48ac-93a6-f2474663c3a1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:13.018782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:13.019673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:13.020008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:13.020335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/548a40dbc77541399c25dd99e88ec169/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:13.022269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=548a40dbc77541399c25dd99e88ec169, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:13.051732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8119385-eb89-4dea-9361-7fbc17c91c07 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:13.108558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 532/1064] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:07:13 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/548a40dbc77541399c25dd99e88ec169/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:07:15.044897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ffb-c48b-43ea-b8a6-a5ac1725f0f3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.045386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ffb-c48b-43ea-b8a6-a5ac1725f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.045553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919ffb-c48b-43ea-b8a6-a5ac1725f0f3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.047428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 533/1065] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:15.053032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.053384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.053721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.077374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:15.078608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:15.144276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 533/1066] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:15.166934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.167280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.168179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.191033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:15.192241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:15.199486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 534/1067] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:15.205100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.215005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b64a4-6223-4e15-b1c2-8eba0822ff61 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.219249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.220049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.220390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.220720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.233018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:15.240312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:15.241545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 534/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:15.247714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.256633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb5121-3548-4781-8d8b-5340bfaa2b4c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.260912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.261555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.261928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.262266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.263060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.263416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.291442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.300950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 535/1069] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:15.306536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.316761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac76f7-777e-4119-b8e2-1ccf31f39df3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.321077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.321878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.322218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.322550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.334562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.363158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.381695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:15.382942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 535/1070] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:15.389002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.398696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bd243-2ba7-4485-9041-58942cfd296b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.403577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.404221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.404561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.404896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.405673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.406073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.433527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.446934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 536/1071] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:15.452730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.462263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a73df-0932-4ca9-84cc-7268785fdfb4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.467111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.467875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.468212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.468543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.484310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.513210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.532692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 12:07:15.533869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 536/1072] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:15.539573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.549181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a60df3-1fc6-4ee3-875b-e5ae64caa49f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.553427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.554124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.554465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.554798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.555676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.556114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.584612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.615168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 537/1073] 10.222.0.18 () {56 vars in 1147 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:15.620920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.630578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286ab0-ce76-4533-b3b4-fe55783210d1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.634857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.635488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.635825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.636650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.644711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.673035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.682147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 537/1074] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:15.688773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.698473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c143ce6-9a40-4764-a050-f67a41ed40f2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.703424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.704217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.704555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.704883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.717010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.745154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.764497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:07:15.765620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 538/1075] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:15.771580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.780553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518dd9-0b6c-46e2-a65c-8a2494936b49 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.784920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.785571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.785943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.786279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.787048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.787399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.815683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.829498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 538/1076] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:15.834922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.844467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf5ab-247e-4760-a467-7890e3739e38 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.848732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.849507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.849887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.850217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.859196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.888444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.903151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:07:15.904277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 539/1077] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:15.910057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.919992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc085-c49a-4a69-b577-4fcb3580dffc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.924323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.924975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.925315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.925649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.926543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.926900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:15.956198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65955122-2b2b-4573-853d-916ff7aa520e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:15.970012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 539/1078] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:15.976238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:15.986197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ede7c-073a-4929-a0fc-3836f1e0a015 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:15.990404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:15.991048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:15.991382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:15.991705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:15.992589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=548a40dbc77541399c25dd99e88ec169) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:15.992943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:16.022515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a141-acd6-4a65-bd40-37219ce1aa2f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:16.029298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 540/1079] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:15 2021] GET /identity/v3/role_assignments?user.id=548a40dbc77541399c25dd99e88ec169&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:18.012684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af3ec-53f5-4288-8302-4f24d64a6d1e None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.013135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af3ec-53f5-4288-8302-4f24d64a6d1e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.013334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82af3ec-53f5-4288-8302-4f24d64a6d1e None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.015205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 540/1080] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:18.020643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.020991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.021330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.044698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:18.045948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:18.053023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 541/1081] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:18.075503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.075842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.076174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.098632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:18.099805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:18.106870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 541/1082] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:18.112573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:18.122572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea32aa-1b9a-4252-96ad-313889a7e33e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:18.126830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:18.127635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.127974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.128306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.129005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:18.157448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:18.169111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 12:07:18.170283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 542/1083] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:07:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:18.176538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:18.186214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a48a8-7c3c-4ec9-bc40-7cd51599d86f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:18.190441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:18.191079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.191414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.191743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.192485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:18.192832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:18.221041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6dcf0-abd0-423b-9b09-e01d82128948 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:18.226236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 542/1084] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:18.231706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:18.241311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734348ea-3b02-4a34-a074-c5f0bebbeed7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:18.246108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:18.246788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:18.247080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:18.247411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:18.248156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:18.248504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:18.276981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87bc12-d426-4a74-9ca5-798b0082446b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:18.281987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 543/1085] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:18 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:20.227449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76735-e147-4ca0-8352-dab38aec9148 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:20.227981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76735-e147-4ca0-8352-dab38aec9148 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:20.228070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76735-e147-4ca0-8352-dab38aec9148 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:20.230551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 543/1086] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:20.236189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:20.236535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:20.236867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:20.260183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:20.261320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:20.268382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 544/1087] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:20.291064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef423a-e4e0-4db6-82d0-ad886d624776 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:20.291416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef423a-e4e0-4db6-82d0-ad886d624776 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:20.291752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef423a-e4e0-4db6-82d0-ad886d624776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:20.315836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0cef423a-e4e0-4db6-82d0-ad886d624776 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:20.317032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0cef423a-e4e0-4db6-82d0-ad886d624776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:20.324265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 544/1088] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:20.329937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:20.339758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22166892-cd41-4292-bac1-c7f73e4c201f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:20.343988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:20.344636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:20.344973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:20.345300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:20.346075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:20.374482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014e6a8-c595-498f-8fa4-38bdd6deca27 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:20.425042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 545/1089] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:07:20 2021] POST /identity/v3/services => generated 241 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:22.389240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0e9-e2c2-47b5-a776-ed4b996a6f88 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.389743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0e9-e2c2-47b5-a776-ed4b996a6f88 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.389914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b0e9-e2c2-47b5-a776-ed4b996a6f88 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.391755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 545/1090] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:22.397173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb834-9398-454e-a022-2f787a162838 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.397524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb834-9398-454e-a022-2f787a162838 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.397889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb834-9398-454e-a022-2f787a162838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.421845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-93fdb834-9398-454e-a022-2f787a162838 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:22.423039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-93fdb834-9398-454e-a022-2f787a162838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:22.441580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 546/1091] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:22 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:22.463464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.463810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.464196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.486956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:22.488144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:22.496208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 546/1092] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:22 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:22.502046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb834-9398-454e-a022-2f787a162838 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:22.512044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb834-9398-454e-a022-2f787a162838 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:22.516297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:22.517102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.517439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.517767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.518510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:22.546260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:22.558311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 12:07:22.559713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 547/1093] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:07:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:22.566180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:22.575667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cfaa1-add4-433f-a840-536d6a476537 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:22.579997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:22.580651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.580989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.581321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.582105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:22.582461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:22.610572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:22.616475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 547/1094] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:22.623258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:22.633002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0e71e-2601-4d19-a57e-3586c9ec2692 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:22.637930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:22.638585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.638922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.639293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.640003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:22.640351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:22.668165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:22.673095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 548/1095] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:22.678905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:22.689239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717b0f-640a-4a41-9603-0d401d1ed5dc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:22.693566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:22.694231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.694568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.694898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.695731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] RBAC: Adding query filter params (interface=public, service_id=ac8a05b5453546fd91d85456f62196f4, region_id=RegionOne) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:22.696085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:22.724503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e97b01-2cf3-405f-91e5-98329b8ebc27 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:22.729958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 548/1096] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:07:22 2021] GET /identity/v3/endpoints?service_id=ac8a05b5453546fd91d85456f62196f4&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:22.735504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:22.745021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5bfb0-9760-42cd-ad8c-6f89bf9256fd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:22.749744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:22.750417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:22.750752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:22.751082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:22.751792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:22.779972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e4500-ee5a-44f9-8c79-5cc9b209bb7a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:22.787224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 549/1097] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:07:22 2021] GET /identity/v3/services => generated 2196 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:07:24.753023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d824c-1176-42e5-a462-dbfa7223b858 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.753565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d824c-1176-42e5-a462-dbfa7223b858 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.753674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d824c-1176-42e5-a462-dbfa7223b858 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.755556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 549/1098] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:24.761240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.761592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.761954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.785682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:24.786925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:24.794663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 550/1099] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:24 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:24.816502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.816847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.817180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.840839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:24.842058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:24.849215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 550/1100] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:24 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:24.855440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:24.864901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52356195-ad68-4c26-80d8-fa2e4fbce4f6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:24.869176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:24.870037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.870376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.870705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.871403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:24.899163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:24.911316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 12:07:24.912463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 551/1101] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:07:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:07:24.919417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:24.928530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b503eb-9fad-400e-a7bb-95d3937b0485 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:24.932836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:24.933742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.934134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.934467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.935225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:24.935578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:24.963625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:24.969631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 551/1102] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:24.975502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:24.985831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f6948-7290-4de2-9851-bba089f19365 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:24.990385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:24.991046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:24.991384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:24.991716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:24.992473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:24.992826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:25.020727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072c6e8-bd7d-487f-ba28-f4455a231682 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:25.025699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 552/1103] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:25.032028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:25.041739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362dc17-8dad-42c1-b0b1-4cebf5b9c190 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:25.046720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:25.047366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:25.047707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:25.048040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:25.048814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:25.077499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424d8ab-ceda-4ccd-ba63-a781b415b920 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:25.127393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 552/1104] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:07:25 2021] POST /identity/v3/endpoints => generated 349 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:27.106175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca505-e1df-4609-a270-41fa350d1ba3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.106712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca505-e1df-4609-a270-41fa350d1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.106817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ca505-e1df-4609-a270-41fa350d1ba3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.108625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 553/1105] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:27.114328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.114677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.115010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.138341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:27.139541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:27.157977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 553/1106] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:27.180073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.180419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.180752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.205992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:27.207173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:27.214737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 554/1107] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:27.220638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:27.230760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c715ffa-5a86-4d22-8cd2-aed9dae8a8d1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:27.235134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:27.235948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.236289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.236621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.237323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:27.265274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:27.277346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 12:07:27.278525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 554/1108] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:07:27 2021] GET /identity/v3/services/object-store => generated 93 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:27.284832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:27.294344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bff0e7-8784-4b57-a124-1dd229dae62f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:27.298603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:27.299252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.299587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.299922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.300716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:27.301063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:27.329814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:27.339644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 555/1109] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:27 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:27.345953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:27.355857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633f95-f5c8-4892-84e2-fdca523c64b4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:27.360126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:27.360782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.361116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.361441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.362242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:27.362596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:27.390720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:27.395654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 555/1110] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:27 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:27.402372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:27.412061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efef5-9499-4f1e-8912-903ffda86e0a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:27.416385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:27.417034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.417373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.417704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.418578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] RBAC: Adding query filter params (interface=admin, service_id=ac8a05b5453546fd91d85456f62196f4, region_id=RegionOne) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:27.418936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:27.446708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04fd3d-cecb-44c1-b99b-00a9e2a0fabc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:27.452578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 556/1111] 10.222.0.18 () {56 vars in 1261 bytes} [Sat Aug 21 12:07:27 2021] GET /identity/v3/endpoints?service_id=ac8a05b5453546fd91d85456f62196f4&interface=admin®ion_id=RegionOne => generated 193 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:27.458243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:27.468513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cbad-e7bb-47be-bc24-df0d81264a70 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:27.472870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:27.473515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:27.473881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:27.474218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:27.474928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:27.503394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3ed81-926b-4055-9b48-8fe148b3ec82 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:27.511313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 556/1112] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:07:27 2021] GET /identity/v3/services => generated 2196 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:07:29.450882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8f3e-077c-4620-97c1-371671aec921 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.451394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8f3e-077c-4620-97c1-371671aec921 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.451519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e8f3e-077c-4620-97c1-371671aec921 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.453328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 557/1113] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:29.458961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.459310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.459644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.482899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:29.484092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:29.491205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 557/1114] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:29.514249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.514593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.514925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.538019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:29.539210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:29.546842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 558/1115] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:29.552561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:29.563065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10d5a2-af61-49c1-9f36-366da9e73b6d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:29.567416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:29.568232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.568574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.568911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.569610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:29.597567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:29.609825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 12:07:29.610952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 558/1116] 10.222.0.18 () {56 vars in 1138 bytes} [Sat Aug 21 12:07:29 2021] GET /identity/v3/services/object-store => generated 93 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:29.617296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:29.626786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29625aa6-de9a-4307-8975-33a51f883d89 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:29.631059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:29.631709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.632049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.632385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.633134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:29.633486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:29.660953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:29.666161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 559/1117] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:29 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:29.672213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:29.681704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db78f5-b6e3-402c-b874-d7646684e562 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:29.686874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:29.687517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.687856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.688188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.688931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:29.689282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:29.717119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041732a-b21e-4108-abda-7f7bae26eb43 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:29.722002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 559/1118] 10.222.0.18 () {56 vars in 1134 bytes} [Sat Aug 21 12:07:29 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:29.727602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:29.737685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405002c8-71c1-49c7-9003-662b7a407923 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:29.742152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:29.742793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:29.743134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:29.743469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:29.744233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:29.772373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8ac38-c2fb-44f9-b36f-b63c10eff02f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:29.845133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 560/1119] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:07:29 2021] POST /identity/v3/endpoints => generated 325 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:31.837381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0003-f46a-4a56-94a2-1870abd42d2d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:31.837962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0003-f46a-4a56-94a2-1870abd42d2d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:31.838083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0003-f46a-4a56-94a2-1870abd42d2d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:31.839930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 560/1120] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:31.845650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:31.846021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:31.846358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:31.870736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:31.871940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:31.889981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 561/1121] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:31.912375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:31.912724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:31.913064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:31.937939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:31.939151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:31.946362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 561/1122] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:31.952091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:31.961517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b678cb-0efe-42bd-81d5-aa2dce4f3585 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:31.965926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:31.966735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:31.967074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:31.967404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:31.968586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:31.997621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07ac71-9bf7-42f6-94ef-1f9d1d682eee admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:31.999323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 562/1123] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:32.005569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:32.015067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac269-1c6c-4a30-8922-aeaed5577087 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:32.019466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:32.020128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:32.020469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:32.020806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:32.021537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:32.050336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439534-f445-4163-ba15-67218ae186f0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:32.138166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 562/1124] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:07:32 2021] POST /identity/v3/projects => generated 311 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:34.129772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61bcc0-b0bc-4db4-a405-e8b5ba4d7e10 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:34.130298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61bcc0-b0bc-4db4-a405-e8b5ba4d7e10 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:34.130487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61bcc0-b0bc-4db4-a405-e8b5ba4d7e10 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:34.132330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 563/1125] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:34.137915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:34.138264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:34.138599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:34.161568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:34.162788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:34.230621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 563/1126] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:34.253649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:34.253974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:34.254314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:34.277433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:34.278662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:34.285811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 564/1127] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:34.291642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:34.301525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a7be1-5c1d-4d77-bcc9-a754a1cce2b2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:34.305767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:34.306591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:34.306930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:34.307259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:34.309275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:34.337033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca6545-586e-4e6a-b1d5-f7fec9154a7e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:34.338683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 564/1128] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:34.344220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:34.353062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25c218-7ae6-4162-b01d-8e6485f4b7ff None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:34.357859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:34.358511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:34.358853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:34.359187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:34.359914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:34.388524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bd90c-17c4-471c-bed6-8d96d39761b4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:34.496774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 565/1129] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:07:34 2021] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:36.495336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7489b1-200c-4660-95e5-c8ea5627f24c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.495880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7489b1-200c-4660-95e5-c8ea5627f24c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.495977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7489b1-200c-4660-95e5-c8ea5627f24c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.497817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 565/1130] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:36.503448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.503794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.504129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.528605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:36.529836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:36.536982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 566/1131] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:36.559358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.559700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.560035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.583518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:36.584699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:36.592454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 566/1132] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:36.598364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.607976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad00d81-e5c0-4189-9381-b8b1dcde9bc2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.612310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.613106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.613447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.613782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.625483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:36.632812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:36.634016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 567/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:36.640794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.649678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76955cf2-b518-4fe7-9b6e-4bebf1d7968b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.654604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.655254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.655587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.655911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.656701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:36.657049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:36.685509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:36.694453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 567/1134] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:36.700686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.710721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2f79-354e-45a8-a365-f3367d01923a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.715037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.715873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.716210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.716541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] PATH_INFO: `/v3/users/ee5eb2e8d92648ca82141f3bd3718c50` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.735319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] RBAC: Authorizing `identity:get_user(user_id=ee5eb2e8d92648ca82141f3bd3718c50)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:36.765013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:36.766597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 568/1135] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/users/ee5eb2e8d92648ca82141f3bd3718c50 => generated 285 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:36.772316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.782214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084648d-dffa-4db1-a337-7aa476dd6486 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.786628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.787260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.787599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.787933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.796140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:36.825367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:36.834423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 568/1136] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:36.840173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.849596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afe46f-2086-4413-8f7c-df43303c3264 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.853874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.854712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.855045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.855375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.856549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:36.885120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b1373-4993-47ce-96ff-1e05ece1cef6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:36.887361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 569/1137] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:36.893215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:36.902356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1033b-271b-429e-be06-99f087a97477 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:36.906751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:36.907386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:36.907729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:36.908064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:36.908937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=c032907e45dc46938de3fa8fed758dc6, user.id=ee5eb2e8d92648ca82141f3bd3718c50) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:36.909299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:36.937854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c2af-ac6f-45c3-aa16-78c1492cdbd4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:36.943370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 569/1138] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:36 2021] GET /identity/v3/role_assignments?user.id=ee5eb2e8d92648ca82141f3bd3718c50&scope.project.id=c032907e45dc46938de3fa8fed758dc6&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:38.906567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c65e-366c-4d22-aa9f-1d4f9badf5f8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:38.907117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c65e-366c-4d22-aa9f-1d4f9badf5f8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:38.907215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c65e-366c-4d22-aa9f-1d4f9badf5f8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:38.909029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 570/1139] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:38.914475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:38.914828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:38.915166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:38.939388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:38.940599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:38.947887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 570/1140] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:38.970489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:38.970837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:38.971171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:38.994950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:38.996148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:39.003386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 571/1141] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:38 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:39.009474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:39.019155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d17296-749d-4075-b66c-3228fd46218b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:39.023476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:39.024282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:39.024624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:39.024959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:39.037171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:39.045076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:39.046280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 571/1142] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:39.052407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:39.061548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7167fa-0b64-481c-a254-4ac4f6a411b8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:39.065849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:39.066498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:39.066833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:39.067166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:39.067958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:39.068308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:39.096510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:39.105940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 572/1143] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:39.111690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:39.121752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418099c-26ed-4e87-b2da-072eb3ed0d25 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:39.126171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:39.127017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:39.127356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:39.127690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] PATH_INFO: `/v3/users/ee5eb2e8d92648ca82141f3bd3718c50` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:39.128884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=ee5eb2e8d92648ca82141f3bd3718c50)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:39.157720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:39.159276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 572/1144] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:39 2021] GET /identity/v3/users/ee5eb2e8d92648ca82141f3bd3718c50 => generated 285 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:39.164817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:39.174980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a2d0-fd5d-4324-bc4c-969264ca96b3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:39.180071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:39.180693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:39.181031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:39.181362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:39.182553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:39.211101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d833db-a401-482e-8847-c39c6f45cf3e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:39.212731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 573/1145] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:39 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:39.218880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:39.228435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ade1-e99d-45a7-b7ed-ac427f27fbd2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:39.233336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:39.234237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:39.234573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:39.234908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6/users/ee5eb2e8d92648ca82141f3bd3718c50/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:39.236800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c032907e45dc46938de3fa8fed758dc6, user_id=ee5eb2e8d92648ca82141f3bd3718c50, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:39.265327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599bccd-4eeb-471d-8612-a4df65347bd7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:39.319334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 573/1146] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:07:39 2021] PUT /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6/users/ee5eb2e8d92648ca82141f3bd3718c50/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:07:41.257747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bb60-d9cc-4453-b45e-7507a497d473 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.258273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bb60-d9cc-4453-b45e-7507a497d473 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.258379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bb60-d9cc-4453-b45e-7507a497d473 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.260216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 574/1147] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:41.266140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.266490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.266821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.289936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:41.291130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:41.356630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 574/1148] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:41.378987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.379331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.379668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.403383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:41.404582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:41.411796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 575/1149] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:41 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:41.417445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.426909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ba66c-2253-4ae3-b493-dc6be6c03844 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.431221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.432019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.432843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.433418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.445030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:41.452925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:41.454830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 575/1150] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:41.460878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.469739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6beb9-212e-4261-b610-bbccbc588a2b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.474089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.474736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.475074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.475409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.476196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:41.476548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:41.505247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:41.514832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 576/1151] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:41.520236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.530378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada0bc-b2cb-4126-9504-a77f35d127e0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.534747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.535601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.535937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.536268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] PATH_INFO: `/v3/users/ee5eb2e8d92648ca82141f3bd3718c50` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.537470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] RBAC: Authorizing `identity:get_user(user_id=ee5eb2e8d92648ca82141f3bd3718c50)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:41.567464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:41.569040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 576/1152] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/users/ee5eb2e8d92648ca82141f3bd3718c50 => generated 285 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:41.574532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.583928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ebff1-a04d-48cb-afed-678ef779ea64 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.588235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.588851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.589190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.589524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.597519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:41.626531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:41.635446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 577/1153] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:41.641255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.650682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb890cb-a53a-4d5e-b65d-2ec37139a2dc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.654949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.655771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.656096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.656418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.657581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:41.686978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ae720-5cd1-4df3-beec-9d7d7a3db95f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:41.688587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 577/1154] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:41.694144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:41.702741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab4596-9fe3-41c8-b276-c8bb1ca522f9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:41.707090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:41.707705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:41.708046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:41.708380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:41.709272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=c032907e45dc46938de3fa8fed758dc6, user.id=ee5eb2e8d92648ca82141f3bd3718c50) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:41.709632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:41.738311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e5a39-47ec-47e9-bb14-9129eca30c1a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:41.744256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 578/1155] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:41 2021] GET /identity/v3/role_assignments?user.id=ee5eb2e8d92648ca82141f3bd3718c50&scope.project.id=c032907e45dc46938de3fa8fed758dc6&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:43.720629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f0b-15fa-49c5-bcf6-79308e802693 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:43.721199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f0b-15fa-49c5-bcf6-79308e802693 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:43.721312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90067f0b-15fa-49c5-bcf6-79308e802693 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:43.723104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 578/1156] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:43.728672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:43.729632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:43.730008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:43.753376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:43.754609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:43.761891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 579/1157] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:43.784178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797456c-820a-431d-8e89-170108c95c1d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:43.784517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797456c-820a-431d-8e89-170108c95c1d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:43.784842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797456c-820a-431d-8e89-170108c95c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:43.808844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a797456c-820a-431d-8e89-170108c95c1d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:43.810052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a797456c-820a-431d-8e89-170108c95c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:43.817102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 579/1158] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:43.823423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:43.832842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c65951-5fc0-459c-80f8-362a77ba52ab None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:43.837181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:43.838005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:43.838945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:43.839281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:43.840497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:43.868289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3ba39-cd03-4b40-ad30-e9248bcccf9a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:43.869901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 580/1159] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:43.875524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797456c-820a-431d-8e89-170108c95c1d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:43.884406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797456c-820a-431d-8e89-170108c95c1d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:43.889168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:43.889942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:43.890282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:43.890611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:43.891336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:43.920148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9862b-a703-487d-8969-87abb91d91f2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:44.056755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 580/1160] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:07:43 2021] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:46.062090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0143-c732-424e-8167-bc3b06d204d3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.062604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0143-c732-424e-8167-bc3b06d204d3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.062701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d0143-c732-424e-8167-bc3b06d204d3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.064528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 581/1161] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:46.070177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.070534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.070874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.094121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:46.095360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:46.102655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 581/1162] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:46.125585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.125969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.126312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.149400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:46.150627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:46.157900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 582/1163] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:46.163567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:46.173501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5ba62-a948-471a-8c8e-27d803e275e8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:46.177842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:46.178702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.179037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.179370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] PATH_INFO: `/v3/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.180801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] RBAC: Authorizing `identity:get_role(role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:46.209001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:07:46.209001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:07:46.209001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:07:46.210012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:46.211409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 582/1164] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:46 2021] GET /identity/v3/roles/8d3ffd13c75a4e7c952e828db384215e => generated 223 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:46.217036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:46.226034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db1af0-d4b5-471b-9d5c-9b265c61f737 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:46.230884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:46.231756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.232103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.232440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] PATH_INFO: `/v3/users/f202aaa2cab048cfa57da108c583ae4c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.251981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] RBAC: Authorizing `identity:get_user(user_id=f202aaa2cab048cfa57da108c583ae4c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:46.280504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:46.282139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 583/1165] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:46 2021] GET /identity/v3/users/f202aaa2cab048cfa57da108c583ae4c => generated 286 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:46.287834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:46.298097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb278d-c9c1-4507-9b76-acf741fe5b5e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:46.302459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:46.303086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.303424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.303754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.312693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:46.340714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:46.349709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 583/1166] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:46 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:46.356001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:46.365484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b3ac7-15dd-432e-aab0-da0219a4106b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:46.370361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:46.371194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.371532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.371861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.373026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:46.401739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14015f8-8323-4580-be91-2822809402d9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:46.403373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 584/1167] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:46 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:46.409199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:46.418647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a634ff-90a9-443c-abb5-7fa32741d4e4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:46.422947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:46.423572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:46.423908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:46.424237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:46.425095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=c032907e45dc46938de3fa8fed758dc6, user.id=f202aaa2cab048cfa57da108c583ae4c) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:46.425450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:46.454025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4162115-9c70-4922-b844-eb2ac131c4b0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:46.459638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 584/1168] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:46 2021] GET /identity/v3/role_assignments?user.id=f202aaa2cab048cfa57da108c583ae4c&scope.project.id=c032907e45dc46938de3fa8fed758dc6&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:48.408934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba17bf-4f16-49cb-b137-453033fb5a3f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.409445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba17bf-4f16-49cb-b137-453033fb5a3f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.409589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba17bf-4f16-49cb-b137-453033fb5a3f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.411454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 585/1169] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:48.417021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.417376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.417717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.442214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:48.443417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:48.451186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 585/1170] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:48 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:48.473294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.473643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.474034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.498970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:48.500239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:48.507594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 586/1171] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:48 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:48.514728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:48.524657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae465c-b40b-4a14-9cdb-5a9ab23006a1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:48.529694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:48.530594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.530930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.531258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] PATH_INFO: `/v3/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.532710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] RBAC: Authorizing `identity:get_role(role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:48.560829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:48.562331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 586/1172] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:48 2021] GET /identity/v3/roles/8d3ffd13c75a4e7c952e828db384215e => generated 223 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:48.568231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:48.577933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4c6ad-c286-415b-84e1-e8d9595c003e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:48.582272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:48.583140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.583472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.583799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] PATH_INFO: `/v3/users/f202aaa2cab048cfa57da108c583ae4c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.584998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] RBAC: Authorizing `identity:get_user(user_id=f202aaa2cab048cfa57da108c583ae4c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:48.613941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:48.615516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 587/1173] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:48 2021] GET /identity/v3/users/f202aaa2cab048cfa57da108c583ae4c => generated 286 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:48.620916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:48.630627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9a81d-7476-4333-b249-3ffd8ab9e2c9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:48.634955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:48.636303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.636642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.636971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.638199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:48.667076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23cad9-76fa-46dc-9eed-716d8acb3d1d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:48.668669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 587/1174] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:48 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:48.674317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:48.684564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d89d71-251a-42f2-9e81-b84ee17e1b6b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:48.688769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:48.689632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:48.689998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:48.690328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6/users/f202aaa2cab048cfa57da108c583ae4c/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:48.692495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c032907e45dc46938de3fa8fed758dc6, user_id=f202aaa2cab048cfa57da108c583ae4c, role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:48.721670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6aa773-3261-473e-a3d4-a421c794da12 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:48.798978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 588/1175] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:07:48 2021] PUT /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6/users/f202aaa2cab048cfa57da108c583ae4c/roles/8d3ffd13c75a4e7c952e828db384215e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:07:50.751443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033132b-8b49-4ecc-b693-90c518edbe71 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:50.752003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033132b-8b49-4ecc-b693-90c518edbe71 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:50.752237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033132b-8b49-4ecc-b693-90c518edbe71 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:50.754143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 588/1176] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:50.759866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:50.760209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:50.760542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:50.783706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:50.784916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:50.850841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 589/1177] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:50.874223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:50.874561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:50.874895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:50.899218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:50.900404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:50.908073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 589/1178] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:50 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:50.913984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:50.924108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029c67-e690-45c6-b7b2-0c3ef138eeee None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:50.928398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:50.929262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:50.929600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:50.929984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] PATH_INFO: `/v3/roles/8d3ffd13c75a4e7c952e828db384215e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:50.931433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] RBAC: Authorizing `identity:get_role(role_id=8d3ffd13c75a4e7c952e828db384215e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:50.958988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:07:50.958988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:07:50.958988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:07:50.959980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:50.961336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 590/1179] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:50 2021] GET /identity/v3/roles/8d3ffd13c75a4e7c952e828db384215e => generated 223 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:50.967529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:50.976629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a831bc-3542-41ff-bfeb-0b49e3904785 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:50.981586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:50.982509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:50.982850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:50.983180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] PATH_INFO: `/v3/users/f202aaa2cab048cfa57da108c583ae4c` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:50.984385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=f202aaa2cab048cfa57da108c583ae4c)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:51.012958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:51.014536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 590/1180] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:50 2021] GET /identity/v3/users/f202aaa2cab048cfa57da108c583ae4c => generated 286 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:51.020581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:51.030926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b256-06b4-4dc1-aeae-315d5d1ffc54 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:51.035229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:51.035869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:51.036215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:51.036549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:51.045209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:51.073413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:51.082482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 591/1181] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:51 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:51.088581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:51.098290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b57fc8-783b-4eb8-a8c7-2f2eb0a864e8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:51.102672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:51.103521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:51.104507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:51.104847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:51.106066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:51.134628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c6284-6865-4d3d-8446-8551487cf755 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:51.136288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 591/1182] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:51 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:51.142230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:51.151600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de8742-760c-4d9e-9dde-ddaf636d99ff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:51.155965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:51.156603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:51.156943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:51.157275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:51.158177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] RBAC: Adding query filter params (role.id=8d3ffd13c75a4e7c952e828db384215e, scope.project.id=c032907e45dc46938de3fa8fed758dc6, user.id=f202aaa2cab048cfa57da108c583ae4c) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:51.158537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:51.187335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1c6ca-d8c7-4558-9e53-4b6ab7dd7320 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:51.193291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 592/1183] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:51 2021] GET /identity/v3/role_assignments?user.id=f202aaa2cab048cfa57da108c583ae4c&scope.project.id=c032907e45dc46938de3fa8fed758dc6&role.id=8d3ffd13c75a4e7c952e828db384215e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:53.177826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ff45-47b2-419f-88d2-5a4daf1a1168 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:53.178349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ff45-47b2-419f-88d2-5a4daf1a1168 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:53.178514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ff45-47b2-419f-88d2-5a4daf1a1168 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:53.180338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 592/1184] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:53.186825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:53.187181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:53.187515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:53.211359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:53.212562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:53.219768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 593/1185] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:53 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:53.241842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:53.242194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:53.242526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:53.266846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:53.267970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:53.275072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 593/1186] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:53 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:53.280926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:53.290518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076a692-6a1b-49b3-9a22-d5a8a3fc9627 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:53.294852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:53.295653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:53.295992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:53.296321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:53.297487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:53.326771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fe9f1-dbe9-4aa3-8275-a5fdb1f026bf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:53.328410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 594/1187] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:53.333975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:53.342823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9f94f-f204-443a-8c78-902563c7d27b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:53.347154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:53.347793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:53.348128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:53.348458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:53.349175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:53.377577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c29b2c-cb94-493f-8405-108fe04aac22 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:53.434753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 594/1188] 10.222.0.18 () {60 vars in 1152 bytes} [Sat Aug 21 12:07:53 2021] POST /identity/v3/projects => generated 311 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:55.438078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bc73-97bd-4868-90b1-ba17c52eaa77 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:55.438581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bc73-97bd-4868-90b1-ba17c52eaa77 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:55.438746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89bc73-97bd-4868-90b1-ba17c52eaa77 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:55.440591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 595/1189] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:55.446241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:55.446594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:55.446934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:55.470341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:55.471542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:55.537525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 595/1190] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:55 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:55.560306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:55.560656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:55.560992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:55.584189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:55.585380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:55.593068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 596/1191] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:55 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:55.598859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:55.608929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4210158-268e-47b0-a70f-ab0e139fb1c8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:55.613192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:55.614017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:55.614359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:55.614689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:55.615858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:55.643896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1d916-ad62-4b7d-a79b-e07e371c017d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:55.645459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 596/1192] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:07:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:55.651671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:55.660520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848098e-caa9-44c4-adcf-12b775844e95 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:55.664846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:55.665490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:55.665846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:55.666775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:55.667509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:55.696001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf09ca-e04a-44b6-8151-a2fdd898eb68 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:55.753297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 597/1193] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:07:55 2021] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:07:57.784975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97296-56ad-4c40-811b-55ccb6cb51cc None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:57.785520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97296-56ad-4c40-811b-55ccb6cb51cc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:57.785630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c97296-56ad-4c40-811b-55ccb6cb51cc None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:57.787488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 597/1194] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:07:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:07:57.793114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:57.793457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:57.793804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:57.860151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:57.861375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:57.868611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 598/1195] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:57.895273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:57.895629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:57.895967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:57.919337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:07:57.920534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:07:57.927762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 598/1196] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:07:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:07:57.934299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:57.943735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d58da-8133-41fa-ba5c-5005a497fe08 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:57.948702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:57.949505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:57.949863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:57.950192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:57.961845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:07:57.973290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:07:57.974550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 599/1197] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:07:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:07:57.981208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:57.990498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21636f9-6dbb-476e-a4b2-b09a4046b0b1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:57.995392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:57.996054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:57.996387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:57.996715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:57.997514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:57.997891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:58.026436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:58.035485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 599/1198] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:07:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:58.041665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:58.051899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e52c3e-773a-449f-8e68-c48268b8ea4a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:58.056239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:58.057732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:58.058356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:58.058681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] PATH_INFO: `/v3/users/cc0c4aa333e344a2a96732367c6fb0b1` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:58.077497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc0c4aa333e344a2a96732367c6fb0b1)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:58.106251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:58.107830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 600/1199] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:07:58 2021] GET /identity/v3/users/cc0c4aa333e344a2a96732367c6fb0b1 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:58.113566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:58.123769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b339-c224-4012-83cf-b7e2824f5631 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:58.128066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:58.128695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:58.129031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:58.129362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:58.137395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:58.165416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:58.175095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 600/1200] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:07:58 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:07:58.181296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:58.191824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8e5b2-4d7f-43dd-83cc-843fd6a3f037 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:58.196115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:58.196972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:58.197309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:58.197637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] PATH_INFO: `/v3/projects/38ac9e7485b74786b44a99311be4b155` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:58.198845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] RBAC: Authorizing `identity:get_project(project_id=38ac9e7485b74786b44a99311be4b155)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:58.227124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7a8fe-6644-495d-ba79-423f10602816 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:58.229256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 601/1201] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:07:58 2021] GET /identity/v3/projects/38ac9e7485b74786b44a99311be4b155 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:07:58.235178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:07:58.244044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd977ffa-fe46-411f-ab6e-d922973fc0bc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:07:58.249124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:07:58.249772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:07:58.250160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:07:58.250496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:07:58.251375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=38ac9e7485b74786b44a99311be4b155, user.id=cc0c4aa333e344a2a96732367c6fb0b1) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:07:58.251737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:07:58.280079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947f06-79e4-43fb-8cdf-301f1487da52 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:07:58.285711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 601/1202] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:07:58 2021] GET /identity/v3/role_assignments?user.id=cc0c4aa333e344a2a96732367c6fb0b1&scope.project.id=38ac9e7485b74786b44a99311be4b155&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:00.220503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed606-e75c-4bf6-90cb-0e069aaf91a6 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.221033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed606-e75c-4bf6-90cb-0e069aaf91a6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.221152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ed606-e75c-4bf6-90cb-0e069aaf91a6 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.223019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 602/1203] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:00.228445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.228799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.229131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.252955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:00.254119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:00.261877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 602/1204] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:00 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:00.283424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.283775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.284115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.308604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:00.309825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:00.316990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 603/1205] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:00 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:00.322871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:00.332358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bfeba-5e5a-4a87-8fb5-6dfae9022986 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:00.336655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:00.337454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.337830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.338149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.349836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:08:00.357584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:08:00.358854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 603/1206] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:08:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:08:00.365013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:00.374536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a3b06-dac6-4d09-8358-077f8d6d266c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:00.378889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:00.379535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.379874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.380209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.381000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:00.381354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:00.409228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:00.418629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 604/1207] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:08:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:00.424245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:00.435166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb01f6-0425-4fae-b009-c00802225582 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:00.439441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:00.440289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.440625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.440954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] PATH_INFO: `/v3/users/cc0c4aa333e344a2a96732367c6fb0b1` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.442161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc0c4aa333e344a2a96732367c6fb0b1)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:00.475258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:00.476842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 604/1208] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:08:00 2021] GET /identity/v3/users/cc0c4aa333e344a2a96732367c6fb0b1 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:00.483133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:00.492793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ab25a-18f2-4bdb-8f30-06aff6173659 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:00.498164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:00.499029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.499367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.499698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] PATH_INFO: `/v3/projects/38ac9e7485b74786b44a99311be4b155` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.500926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] RBAC: Authorizing `identity:get_project(project_id=38ac9e7485b74786b44a99311be4b155)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:00.529522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ec7af-1e47-427e-828c-8dc04b9a9cde admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:00.531133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 605/1209] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:08:00 2021] GET /identity/v3/projects/38ac9e7485b74786b44a99311be4b155 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:00.536875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:00.547207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572fd1-f4e0-4d00-aea7-954170bd47e6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:00.551568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:00.552444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:00.552783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:00.553116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] PATH_INFO: `/v3/projects/38ac9e7485b74786b44a99311be4b155/users/cc0c4aa333e344a2a96732367c6fb0b1/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:00.555050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ac9e7485b74786b44a99311be4b155, user_id=cc0c4aa333e344a2a96732367c6fb0b1, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:00.584865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd23cd-e442-410b-b5e7-8dceaffa3601 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:00.629426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 605/1210] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:08:00 2021] PUT /identity/v3/projects/38ac9e7485b74786b44a99311be4b155/users/cc0c4aa333e344a2a96732367c6fb0b1/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:08:02.588882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9dcc-e8fd-4f8e-a4a2-fa22703463d1 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.589404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9dcc-e8fd-4f8e-a4a2-fa22703463d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.589529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df9dcc-e8fd-4f8e-a4a2-fa22703463d1 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.591393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 606/1211] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:02.596841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.597192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.597529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.622020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:02.623226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:02.689276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 606/1212] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:02.711505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.711854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.712186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.735634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:02.736820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:02.743876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 607/1213] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:02 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:02.750278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:02.759814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5585cc-a6b9-46b9-af56-cf716d852243 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:02.764172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:02.764966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.765307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.765636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.777267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:08:02.784570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:08:02.785734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 607/1214] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:08:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:08:02.792613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:02.801553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b09da7-89e7-443d-b9cc-708a50ea833d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:02.805893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:02.807138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.807478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.808058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.808893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:02.809247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:02.837061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:02.846430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 608/1215] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:08:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:02.852622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:02.865724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a08911-e356-4efe-8207-6965675c195f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:02.870784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:02.871647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.871984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.872314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] PATH_INFO: `/v3/users/cc0c4aa333e344a2a96732367c6fb0b1` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.873498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] RBAC: Authorizing `identity:get_user(user_id=cc0c4aa333e344a2a96732367c6fb0b1)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:02.902124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:02.903709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 608/1216] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:08:02 2021] GET /identity/v3/users/cc0c4aa333e344a2a96732367c6fb0b1 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:02.909913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:02.920505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90381c-af81-45a6-80f2-797b1959cbf2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:02.925059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:02.925706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.926058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.926578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.934902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:02.963278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:02.972502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 609/1217] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:08:02 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:08:02.979288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:02.989137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a16fa-9fc5-44ad-8061-e0126281ad8e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:02.993453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:02.994368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:02.994706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:02.995033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] PATH_INFO: `/v3/projects/38ac9e7485b74786b44a99311be4b155` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:02.996248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] RBAC: Authorizing `identity:get_project(project_id=38ac9e7485b74786b44a99311be4b155)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:03.024207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af00309-7026-463b-b6b9-f3a408e34f34 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:03.026496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 609/1218] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:08:02 2021] GET /identity/v3/projects/38ac9e7485b74786b44a99311be4b155 => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:03.032553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:03.042259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac147067-41ec-490a-a7cc-bca72a793175 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:03.046594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:03.047234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:03.047573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:03.047901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:03.048775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=38ac9e7485b74786b44a99311be4b155, user.id=cc0c4aa333e344a2a96732367c6fb0b1) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:03.049133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:03.077470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2acf4d-0925-49c7-be6a-f83eaf6f5c4b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:03.083415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 610/1219] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:08:03 2021] GET /identity/v3/role_assignments?user.id=cc0c4aa333e344a2a96732367c6fb0b1&scope.project.id=38ac9e7485b74786b44a99311be4b155&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:05.056692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b8a0d-226f-4dc4-b41f-5e6acdcb46c4 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.057183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b8a0d-226f-4dc4-b41f-5e6acdcb46c4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.057347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b8a0d-226f-4dc4-b41f-5e6acdcb46c4 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.059477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 610/1220] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:05.064877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.065226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.065559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.089850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:05.091040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:05.098158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 611/1221] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:05 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:05.119280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.119631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.119968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.143572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:05.144779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:05.152647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 611/1222] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:05 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:05.158551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:05.167902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff55363-4a33-47ea-84f1-1b849d204321 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:05.172185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:05.172814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.173148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.173477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.182002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:05.210632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:05.219534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 612/1223] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:08:05 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:08:05.225341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:05.234312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dddef-f9ca-4375-8f31-4369850c348b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:05.238683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:05.239473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.239813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.240143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.249075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:05.277682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:05.293562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-79056ec9-10b6-496b-82b1-d021153f53ee admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 12:08:05.294744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 612/1224] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:08:05 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:08:05.301156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:05.310810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a5220-1241-41d4-b113-9fa4996a7cdd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:05.315122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:05.315762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:05.316101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:05.316433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:05.317187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:05.317536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:05.345892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e7f7e-3cfd-4a41-99bd-d65590db5bcf admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:05.354090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 613/1225] 10.222.0.18 () {56 vars in 1127 bytes} [Sat Aug 21 12:08:05 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:07.306007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6c4b-7eb3-4d53-acfc-f8cc2682cc7c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:07.307082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6c4b-7eb3-4d53-acfc-f8cc2682cc7c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:07.307082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6c4b-7eb3-4d53-acfc-f8cc2682cc7c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:07.309204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 613/1226] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:07.314615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:07.314966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:07.315303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:07.339855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:07.341097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:07.348166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 614/1227] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:07.370857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43c3-8f64-4770-bc10-e96f0ed84b55 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:07.371199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43c3-8f64-4770-bc10-e96f0ed84b55 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:07.371534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43c3-8f64-4770-bc10-e96f0ed84b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:07.394173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c9ea43c3-8f64-4770-bc10-e96f0ed84b55 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:07.395366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c9ea43c3-8f64-4770-bc10-e96f0ed84b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:07.404054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 614/1228] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:07 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:07.409901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:07.419849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36c72-eb0d-4f36-a38f-7b602d178960 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:07.424106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:07.424753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:07.425086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:07.425411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:07.426199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:07.453460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:08:07.453460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:08:07.453460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:08:07.454481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e7530-70d5-4cb8-82ed-6e869420e11a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:07.505101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 615/1229] 10.222.0.18 () {60 vars in 1150 bytes} [Sat Aug 21 12:08:07 2021] POST /identity/v3/domains => generated 267 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:08:09.524402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f210-5c85-4b78-b041-f20046298c81 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:09.524939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f210-5c85-4b78-b041-f20046298c81 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:09.525641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49f210-5c85-4b78-b041-f20046298c81 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:09.527541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 615/1230] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:09.533042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:09.533395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:09.533730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:09.556865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:09.558337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:09.623517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 616/1231] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:09 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:09.646645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:09.646994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:09.647330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:09.670600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:09.671789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:09.678945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 616/1232] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:09 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:09.685555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:09.694943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f7fa-656b-45fe-a259-c1cc398ceeef None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:09.699830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:09.700686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:09.701022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:09.701352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] PATH_INFO: `/v3/domains/89644e47bad84c56ad89bccd827bc77e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:09.713613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=89644e47bad84c56ad89bccd827bc77e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:09.741853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b89ad0-79d7-40da-9413-eef4e35cb359 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:09.743489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 617/1233] 10.222.0.18 () {56 vars in 1195 bytes} [Sat Aug 21 12:08:09 2021] GET /identity/v3/domains/89644e47bad84c56ad89bccd827bc77e => generated 267 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:09.749537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:09.758547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6754f-9970-4495-b464-009ddc14ee41 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:09.763480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:09.764126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:09.764463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:09.764796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:09.765517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:09.793738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21165a16-e877-44d3-a004-edd5602f4c8e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:09.905843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 617/1234] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:08:09 2021] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:08:11.894353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee408-0969-4963-89a6-bce7dc3b56fd None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:11.894880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee408-0969-4963-89a6-bce7dc3b56fd None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:11.895032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ee408-0969-4963-89a6-bce7dc3b56fd None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:11.896834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 618/1235] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:11.902915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:11.903265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:11.903601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:11.926974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:11.928168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:11.994613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 618/1236] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:11 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:12.016504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:12.016839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:12.017172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:12.041357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:12.042574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:12.049639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 619/1237] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:12 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:12.055508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:12.065124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3aed58-4566-46c4-8b69-0cb3b1758682 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:12.069395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:12.070313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:12.070652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:12.070987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] PATH_INFO: `/v3/domains/89644e47bad84c56ad89bccd827bc77e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:12.072165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=89644e47bad84c56ad89bccd827bc77e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:12.100811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd07d-89fa-4052-86b6-a81434f32233 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:12.102455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 619/1238] 10.222.0.18 () {56 vars in 1195 bytes} [Sat Aug 21 12:08:12 2021] GET /identity/v3/domains/89644e47bad84c56ad89bccd827bc77e => generated 267 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:12.108526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:12.117314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478386ca-4bcc-4728-b424-62c8ac319ee6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:12.121613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:12.122297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:12.122636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:12.122969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:12.123697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:12.152304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d007ec-da94-46d2-a600-c208260140ca admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:12.263735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 620/1239] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Aug 21 12:08:12 2021] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:08:14.261116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4956d41-d441-446f-bc76-14152931b26d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.261651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4956d41-d441-446f-bc76-14152931b26d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.261651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4956d41-d441-446f-bc76-14152931b26d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.263529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 620/1240] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:14.269353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.269707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.270074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.293294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:14.294530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:14.301729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 621/1241] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:14 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:14.325149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.325499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.325861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.349210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:14.350432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:14.357629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 621/1242] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:14 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:14.363399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.373258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c055ab6-0667-4855-819a-96a595587eb1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.377497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.378344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.378688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.379024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.391307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:08:14.398638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:08:14.399916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 622/1243] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:08:14.406227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.415083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24565624-e32a-4409-88d6-1da0d4a61f27 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.419409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.420058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.420400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.420734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.421530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:14.421912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:14.451235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:14.460083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 622/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:14.465817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.475792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cc0c6-ef0d-4105-a7ea-e1ef5d83f0b8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.480067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.480905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.481245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.481577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] PATH_INFO: `/v3/users/2130723b305f4487bc6fd2d34f4e5eba` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.501319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2130723b305f4487bc6fd2d34f4e5eba)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:14.530329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:14.531861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 623/1245] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/users/2130723b305f4487bc6fd2d34f4e5eba => generated 311 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:14.537707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.548036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d2074-68d5-4991-a514-daa779a913cf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.552385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.553029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.553370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.553707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.562760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:14.590751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:14.599727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 623/1246] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:08:14.606160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.615641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafac2ce-ed9a-4d2c-8e96-90b5764110e4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.620551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.621422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.621731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.622104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] PATH_INFO: `/v3/projects/5e9fb8cd19474178a42340690072945c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.623272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e9fb8cd19474178a42340690072945c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:14.651332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e685f-a4e0-4f0e-9eac-656ea86cd532 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:14.652954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 624/1247] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/projects/5e9fb8cd19474178a42340690072945c => generated 361 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:14.658831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:14.668093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bb91-c40a-4961-bc4f-3cb69f1350b8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:14.672421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:14.673049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:14.673385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:14.673712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:14.674597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=5e9fb8cd19474178a42340690072945c, user.id=2130723b305f4487bc6fd2d34f4e5eba) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:14.674952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:14.703836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e99c-ebb4-4f45-86c2-e9c739c6f6cd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:14.709320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 624/1248] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:08:14 2021] GET /identity/v3/role_assignments?user.id=2130723b305f4487bc6fd2d34f4e5eba&scope.project.id=5e9fb8cd19474178a42340690072945c&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:16.641146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0d2fe-2023-4678-bbe8-17bf44262bc8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.641689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0d2fe-2023-4678-bbe8-17bf44262bc8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.641820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0d2fe-2023-4678-bbe8-17bf44262bc8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.643654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 625/1249] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:16.649035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.649391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.650271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.674275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:16.675467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:16.682948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 625/1250] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:16.704007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.704356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.704691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.728748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:16.729947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:16.737037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 626/1251] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:16 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:16.742820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:16.752281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cc36a-0dfb-428d-b930-3bfd1619c626 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:16.756588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:16.757391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.757735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.758101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.769759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:08:16.777570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:08:16.778757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 626/1252] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:08:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 12:08:16.784861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:16.794291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a676347-8f0a-4201-8da5-8b87b849a5ec None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:16.798550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:16.799229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.799565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.799896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.800682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:16.801030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:16.829549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:16.838959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 627/1253] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:08:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:16.844630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:16.854716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b927b6-cd82-44c8-ba24-7058b19be7f4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:16.859136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:16.859981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.860318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.860650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] PATH_INFO: `/v3/users/2130723b305f4487bc6fd2d34f4e5eba` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.861858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] RBAC: Authorizing `identity:get_user(user_id=2130723b305f4487bc6fd2d34f4e5eba)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:16.890756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:16.892380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 627/1254] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:08:16 2021] GET /identity/v3/users/2130723b305f4487bc6fd2d34f4e5eba => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:16.897921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:16.908076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d99b-7d59-4c9e-823c-2c79a67258b4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:16.912349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:16.913200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.913535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.913894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] PATH_INFO: `/v3/projects/5e9fb8cd19474178a42340690072945c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.915071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e9fb8cd19474178a42340690072945c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:16.943477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71c9d-bd3f-4564-a6ca-d3b439754584 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:16.945177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 628/1255] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:08:16 2021] GET /identity/v3/projects/5e9fb8cd19474178a42340690072945c => generated 361 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:16.951432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:16.961068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500225-f1df-47cf-9a2b-bf292e2be113 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:16.966127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:16.967015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:16.967353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:16.967693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] PATH_INFO: `/v3/projects/5e9fb8cd19474178a42340690072945c/users/2130723b305f4487bc6fd2d34f4e5eba/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:16.969713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9fb8cd19474178a42340690072945c, user_id=2130723b305f4487bc6fd2d34f4e5eba, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:16.998696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b98f0-26ca-487a-b6b4-37fcc4ea10b7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:17.046905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 628/1256] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:08:16 2021] PUT /identity/v3/projects/5e9fb8cd19474178a42340690072945c/users/2130723b305f4487bc6fd2d34f4e5eba/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:08:19.003613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678aed-dab5-43f0-8da4-f17579657107 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.004007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678aed-dab5-43f0-8da4-f17579657107 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.004276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678aed-dab5-43f0-8da4-f17579657107 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.006163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 629/1257] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:08:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:08:19.012370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.012717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.013050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.037822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:19.039034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:19.181899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 629/1258] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:19.204607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.204954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.205292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.228979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:08:19.230212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:08:19.237422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 630/1259] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:08:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:08:19.243188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.253286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded441a-cb4a-4e3e-b5e1-bb53896ad54b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.257589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.258417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.258755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.259109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.270785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:08:19.278029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:08:19.279258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 630/1260] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:08:19.285552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.294955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e33f8-f19d-4fa7-ace4-da5eea8d8ea2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.299284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.299929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.300270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.300605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.301396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:19.301747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:19.330531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:19.339412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 631/1261] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:19.345035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.355586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f7f3a-d397-4c32-85ba-44f337e910df admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.359873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.360718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.361055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.361385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] PATH_INFO: `/v3/users/2130723b305f4487bc6fd2d34f4e5eba` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.362568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] RBAC: Authorizing `identity:get_user(user_id=2130723b305f4487bc6fd2d34f4e5eba)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:19.391423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:19.393062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 631/1262] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/users/2130723b305f4487bc6fd2d34f4e5eba => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:19.398653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.408687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99801da-8fec-432f-9085-f9ab8dadbadb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.413055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.413676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.414044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.414378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.422977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:19.451235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:19.460681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 632/1263] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:08:19.467537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.477274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d05a7-c088-44cc-be84-b70216b02a19 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.482202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.483065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.483402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.483731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] PATH_INFO: `/v3/projects/5e9fb8cd19474178a42340690072945c` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.484916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] RBAC: Authorizing `identity:get_project(project_id=5e9fb8cd19474178a42340690072945c)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:19.514622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453523c4-47e5-4cd6-bdfb-c98227664246 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:19.516234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 632/1264] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/projects/5e9fb8cd19474178a42340690072945c => generated 361 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:08:19.522526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:08:19.532076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601f8ba-29d6-4889-9c8d-e2d5ab60c259 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:08:19.536485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:08:19.537129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:08:19.537469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:08:19.537817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:08:19.538719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=5e9fb8cd19474178a42340690072945c, user.id=2130723b305f4487bc6fd2d34f4e5eba) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:08:19.539080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:08:19.567944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb4bf-823e-4c1c-a924-f550ed7bd1c1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:08:19.573937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 633/1265] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:08:19 2021] GET /identity/v3/role_assignments?user.id=2130723b305f4487bc6fd2d34f4e5eba&scope.project.id=5e9fb8cd19474178a42340690072945c&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:19.642069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367b19-f6f0-4edc-b04a-e228e1effa0c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:19.642683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367b19-f6f0-4edc-b04a-e228e1effa0c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:19.642803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85367b19-f6f0-4edc-b04a-e228e1effa0c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:19.644794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 633/1266] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:19.650401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:19.650755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:19.651088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:19.745633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:19.746868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:19.790138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 634/1267] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:19.813637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:19.814013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:19.814354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:19.837977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:19.839207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:19.846927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 634/1268] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:19.853986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:19.863916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f16c26-f5c0-4bad-99f6-ed4cfd645279 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:19.869020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:19.869856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:19.870204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:19.870543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:19.882910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:19.911027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:19.930668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:19.931853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 635/1269] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:19.939602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:19.948854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d253ee-8d50-43fe-87f5-ba3d8a066823 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:19.953323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:19.954053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:19.954390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:19.954716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:19.955484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:19.955810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:19.984408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e8023-966c-426e-9f6e-ddd77abf58e8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:19.998510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 635/1270] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:20.004765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:20.015162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273cc9e-8bb3-4a3c-bb5c-908dbf92bcaa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:20.019750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:20.020438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:20.020801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:20.021157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:20.021956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:20.052732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d307a-90ce-4f13-acc4-0bdab15d3c24 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:20.212247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 636/1271] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:12:20 2021] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:12:22.226008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1924-b343-4eb3-8701-6407cf07b34e None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.227026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1924-b343-4eb3-8701-6407cf07b34e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.227149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1924-b343-4eb3-8701-6407cf07b34e None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.229021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 636/1272] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:22.234570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.234923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.235266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.259121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:22.260265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:22.267663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 637/1273] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:22.291193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.291540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.291880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.315463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:22.316677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:22.324073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 637/1274] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:22.330058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.340118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57b9f0-cc33-4b94-9198-cacb5cc995f6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.344527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.345333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.345676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.346061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.358579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:22.365966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:12:22.367265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 638/1275] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:22.373610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.382691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29772ef-3bf2-404b-82fa-6f074dbee0df None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.387132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.387791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.388131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.388457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.389251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:22.389601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.418490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.427237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 638/1276] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:22.433175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.443374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdd85-23a5-40d2-aae0-201ea9938639 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.447875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.448669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.449013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.449350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.462312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.491122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.510533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:22.511670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 639/1277] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:22.517910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.528250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e773f05-fa3d-4581-91a3-fc3d03505654 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.532596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.533253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.533588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.534005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.534771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:22.535119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.563714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.576745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 639/1278] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:22.582540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.592769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99995-3e61-437a-aeab-e9be8d8375b5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.597163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.597983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.598326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.598660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.612538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.641394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.661322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:22.662571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 640/1279] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:22.668656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.679255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34907428-ffde-453b-bb3f-89196852cdd9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.683746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.684409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.684747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.685080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.685992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:22.686345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.717333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.749270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 640/1280] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:22.755113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.765508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558c55-6b7c-40f7-9742-2a55dc601f79 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.769859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.770495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.770837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.771169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.779957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.808456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.818235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 641/1281] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:12:22.824693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.834789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ccd55-c1b4-4dc3-9a6c-1a3aa031cb2f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.839930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.840780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.841144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.841501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.854517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.883193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.901658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:22.902834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 641/1282] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:22.908834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.917688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eebb46-8850-4488-a6c2-dc0b0ab9b343 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.922068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.922708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.923043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.923371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.924129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:22.924476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:22.952973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:22.966153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 642/1283] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:22.972711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:22.983299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35ddb-4518-4a6e-83e3-993a2672def2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:22.987982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:22.988800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:22.989156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:22.989511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:22.999292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:23.030494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:23.046040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:23.047273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 642/1284] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:23.053746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:23.064075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdec4d-0dbc-4773-ae16-d6eef2a65766 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:23.068411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:23.069060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:23.069395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:23.069731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:23.071240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:23.071592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:23.099506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87698394-ed37-4afd-ab35-3137c142a7a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:23.114628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 643/1285] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:23.121426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:23.131635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa669c0-7a35-4d0a-8792-d7e671834b60 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:23.136741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:23.137402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:23.137759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:23.138148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:23.139093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=6eb3b883c2164df9b87386f1cecb0972) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:23.139472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:23.169168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca1744-4f38-4356-b5e2-790ed2116703 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:23.175166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 643/1286] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:12:23 2021] GET /identity/v3/role_assignments?user.id=6eb3b883c2164df9b87386f1cecb0972&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:25.387371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a1ca-234f-419a-91ad-c9d10639b5ad None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.387878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a1ca-234f-419a-91ad-c9d10639b5ad None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.388026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a1ca-234f-419a-91ad-c9d10639b5ad None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.390166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 644/1287] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:25.396161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.396519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.396859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.423055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:25.424279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:25.431884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 644/1288] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:25.456427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.456798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.457156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.482008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:25.483285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:25.490793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 645/1289] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:25.496982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.506656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24ea65-69b5-45a2-9a27-557bc8bea01d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.511002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.511813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.512155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.512488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.524736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:25.532181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:12:25.533350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 645/1290] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:25.541223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.550363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3faa0-b07a-4aa2-a76e-860df448a45b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.555278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.556072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.556438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.556811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.557728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:25.558182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:25.590873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:25.600612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 646/1291] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:25.606931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.617016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccbbea-c9d4-4fdc-b02b-a292b7b93523 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.621391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.622195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.622535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.622865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.634987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:25.663777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:25.682659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:25.683801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 646/1292] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:25.689642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.699879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03246a5-c10f-4553-97fe-0848042c2dfa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.704282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.704932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.705275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.705613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.706419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:25.706773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:25.735240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:25.748499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 647/1293] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:25.755262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.767354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcf94e-1108-4b07-9728-2b8f0ac0853e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.772488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.774145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.774569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.774963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.792191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:25.827747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:25.851361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:25.852849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 647/1294] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/users/placement => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:25.859150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.869130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015c3ce-9291-4242-b9dc-d73631f0bbb2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.873507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.874213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.874561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.874901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.875801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:25.876162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:25.905307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:25.936047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 648/1295] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:25.942018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:25.953635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bcf25-7d94-4af1-a5a4-b200d5ed8efb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:25.958517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:25.959418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:25.959791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:25.960158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:25.974938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:26.007265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:26.027423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:26.028680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 648/1296] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:26.034902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:26.044820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50905a47-3ed5-428f-8abd-29b19f27ee5a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:26.049225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:26.049914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:26.050305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:26.050645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:26.051426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:26.051782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:26.080830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:26.097887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 649/1297] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:26.101377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:26.113608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816d8ad-2354-4c0c-9e11-23575922ae44 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:26.119011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:26.119975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:26.120374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:26.120770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:26.131504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:26.166056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:26.184168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:26.185603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 649/1298] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:26.191913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:26.202470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c5ff-d317-498b-a2a0-a8c010542c45 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:26.206855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:26.207508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:26.207849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:26.208181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:26.209022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:26.209380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:26.237448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775868d-1530-4cb6-9ce8-c11cdfbc6ea5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:26.251654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 650/1299] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:26.259433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:26.269338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8451c9-4a67-4ddf-8bd1-a20e7aedf905 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:26.273628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:26.274583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:26.274915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:26.275239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/6eb3b883c2164df9b87386f1cecb0972/roles/3de22e2140d249608b449af97da44592` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:26.299032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=6eb3b883c2164df9b87386f1cecb0972, role_id=3de22e2140d249608b449af97da44592)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:26.335041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f711a-7fd5-495d-9404-ea97d19e6676 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:26.382135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 650/1300] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:12:26 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/6eb3b883c2164df9b87386f1cecb0972/roles/3de22e2140d249608b449af97da44592 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:12:28.364690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673882-5b99-4178-9855-9d3abec468c4 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.365208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673882-5b99-4178-9855-9d3abec468c4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.365310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c673882-5b99-4178-9855-9d3abec468c4 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.367166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 651/1301] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:28.373219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.373572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.373956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.398138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:28.399356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:28.466185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 651/1302] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:28.488888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.489240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.489580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.514075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:28.515274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:28.522503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 652/1303] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:28.528561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.538180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8ae9e-dec7-4f1d-9b9b-6cf64b4962d5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.542540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.543347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.543690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.544026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.556603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:28.564020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 12:12:28.565192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 652/1304] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:28.572130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.581060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63b81-ef7d-4e6c-ad51-067d4058cd36 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.585389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.586069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.586410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.586742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.587538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:28.587892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:28.616291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:28.625588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 653/1305] 10.222.0.18 () {56 vars in 1115 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:28.631319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.641430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8e262-ea70-4793-9d51-b733d5f42e6a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.645865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.646636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.646975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.647311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.658990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:28.688728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:28.707793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:28.708951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 653/1306] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:28.715499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.726361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40514fe8-177f-49d1-8faa-6546e52e1459 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.731634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.732403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.732807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.733201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.734018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:28.734404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:28.766682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:28.781604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 654/1307] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:28.787173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.797425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248a305-0acc-4169-ae0d-347abd4b3164 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.801732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.802549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.803149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.803473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.819847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:28.847958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:28.867858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:28.869496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 654/1308] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:28.876194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.887159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bca6c1-5645-4ac5-925b-2e9952d03ce5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.891921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.892690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.893052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.893440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.894430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:28.894853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:28.927520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:28.963266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 655/1309] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:28.969532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:28.980017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7a12-3969-4fc8-b850-58a7a4bfcf5b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:28.984360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:28.985000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:28.985334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:28.985664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:28.994583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.022445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.031954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 655/1310] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:12:28 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:12:29.038292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:29.048742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221adf-0b12-47a7-90fa-7c7da75c1a5e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:29.053496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:29.054358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:29.054707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:29.055058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:29.067668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.098252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.117580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:29.118887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 656/1311] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:29.125092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:29.140296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f3f6d-8b7c-4271-b277-1f7ddeb8700c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:29.140296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:29.140296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:29.140296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:29.140732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:29.140732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:29.140732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.169558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.183693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 656/1312] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:29.189732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:29.200347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f95c28-15d2-4a00-a4e9-f589d0563db5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:29.204826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:29.205629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:29.206008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:29.206345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:29.215696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.244451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.260006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:29.261163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 657/1313] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:29.267139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:29.277250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03612ced-fbaa-453b-bc29-3949d0a4ee08 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:29.281578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:29.282251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:29.282586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:29.282915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:29.283740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:29.284089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.312863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ecf8b-a822-40fd-92d0-795355e419bc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.326300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 657/1314] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:29.332747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:29.343046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9672-ad4f-4524-a961-6cf50b8fa25f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:29.347405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:29.348055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:29.348392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:29.348721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:29.349610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] RBAC: Adding query filter params (role.id=3de22e2140d249608b449af97da44592, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=6eb3b883c2164df9b87386f1cecb0972) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:29.350005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:29.378795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186fc98-7c6d-41a6-a125-cc2aafd598af admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:29.384811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 658/1315] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:12:29 2021] GET /identity/v3/role_assignments?user.id=6eb3b883c2164df9b87386f1cecb0972&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=3de22e2140d249608b449af97da44592 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:31.598027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9076b-916d-4382-9b9c-60ffdb4e93f4 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.598557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9076b-916d-4382-9b9c-60ffdb4e93f4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.598662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9076b-916d-4382-9b9c-60ffdb4e93f4 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.600505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 658/1316] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:31.607342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.607753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.608155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.636915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:31.638303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:31.646440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 659/1317] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:31.672098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.672443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.672778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.695743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:31.696940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:31.704222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 659/1318] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:31 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:31.710664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:31.721213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b2bcc-c5ff-4660-a573-a1334b53ee91 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:31.725600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:31.726410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.726753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.727081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.739625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:31.747180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:12:31.748507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 660/1319] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:12:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:31.754952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:31.763907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c171b-8600-413a-89a7-5a7e98604c9e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:31.768399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:31.769054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.769389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.769719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.770539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:31.770920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:31.800084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:31.809995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 660/1320] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:12:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:31.815778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:31.826490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13af37-627c-4414-88d3-c13282cc66eb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:31.830775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:31.831545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.831880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.832209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.843816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:31.872298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:31.891480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:31.892628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 661/1321] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:31.898636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:31.909345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474edf9d-6c64-4c18-8169-422753697f45 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:31.913919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:31.914591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.914955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.915311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.916104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:31.917004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:31.947342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:31.961599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 661/1322] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:31.967426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:31.977404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a803cbc-1d73-46da-aeb0-a1227d4a40f1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:31.982296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:31.983094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:31.983426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:31.983750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:31.997669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.025837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.045530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:32.046741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 662/1323] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:32.053286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.063898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1fa07-b0b0-413d-9aff-7b40148c73dc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.068282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.068948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.069287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.069620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.070566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:32.070922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.098891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.130539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 662/1324] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:32.136394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.146081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ffe00-7e2f-41e7-8f20-c43996c3637e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.150382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.151012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.151346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.151670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.159712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.188784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.197625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 663/1325] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:12:32.203588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.213282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07386d6-c264-4a5c-aa61-fd4f5ee05667 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.217634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.218486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.218828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.219166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.231824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.260433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.278641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:32.279852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 663/1326] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:32.285775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.295559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415899-2c9e-48de-8582-051baa4e9ee5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.300035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.300696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.301038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.301392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.302226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:32.302824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.331538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.345515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 664/1327] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:32.351381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.362575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9f5c6-63f0-4953-bb3f-a38eb33963e5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.367011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.367794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.368155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.368538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.378816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.409657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.424879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:32.426057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 664/1328] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:32.432708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.442362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfcffc-eed4-461e-9cac-4d1fa4a98c4c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.446682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.447322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.448227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.448559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.449387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:32.449738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.478256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef3301-6883-4c11-beda-c30d89ec82b5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.492302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 665/1329] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:32.498271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:32.507901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3f04-7a40-4c7e-845b-3dc2e752648a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:32.512247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:32.512872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:32.513205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:32.513533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:32.514431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=6eb3b883c2164df9b87386f1cecb0972) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:32.514788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:32.543837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8054b-f3a4-4d03-8059-2c738109157a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:32.549589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 665/1330] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:12:32 2021] GET /identity/v3/role_assignments?user.id=6eb3b883c2164df9b87386f1cecb0972&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:34.516751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb206b-f367-4814-b8b9-c453564b1409 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.517267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb206b-f367-4814-b8b9-c453564b1409 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.517415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb206b-f367-4814-b8b9-c453564b1409 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.519275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 666/1331] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:34.524767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.525123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.525465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.550256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:34.551470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:34.559655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 666/1332] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:34.581506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.581891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.582226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.605877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:34.607060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:34.614227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 667/1333] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:34 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:34.620049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.629556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4a1d6-55b6-4247-a274-c8484a96a059 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.633962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.634761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.635125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.635465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.647252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:34.655078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:12:34.656318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 667/1334] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:34.662607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.672052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3233-ae6d-46c7-b48c-f2abf1474743 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.676396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.677037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.677373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.677988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.678778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:34.679125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:34.706821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:34.716198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 668/1335] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:34.721674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.732414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969de0a-babf-4c1b-b180-97f82d1d213d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.736817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.737587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.737973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.738310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.750440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:34.779392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:34.798142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:34.799291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 668/1336] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:34.805270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.815434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675a4e3-bd10-4c59-accb-ac3f71dd701b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.819769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.820447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.820782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.821111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.821902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:34.822250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:34.850468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:34.863761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 669/1337] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:34.869950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.879692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844fa4d-1014-46cc-a5df-9421fe21379d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.884072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.884871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.885819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.886173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.901799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:34.930196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:34.950658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:34.951817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 669/1338] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:34.957948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:34.967888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e270e5-8152-4290-bc6e-ba4935063e41 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:34.972363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:34.973036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:34.973380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:34.973719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:34.974668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:34.975029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.004346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.035243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 670/1339] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:35.041849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:35.051983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05174f57-58e4-4651-963b-2a9ca1561f4e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:35.056721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:35.058145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:35.058489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:35.058821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:35.071984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.101374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.121902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:35.123086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 670/1340] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:35.128911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:35.138656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75d3b-b134-441e-9005-91fef9789ca7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:35.143044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:35.143702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:35.144042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:35.144377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:35.145149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:35.145502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.173855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.187264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 671/1341] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:35.193548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:35.205191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafc78a-ba59-465e-9b7d-259f18907d06 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:35.209961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:35.210874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:35.211227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:35.211595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:35.222577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.253868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.270616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:35.271980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 671/1342] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:35.278591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:35.288496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b081c9-c4b9-4135-8b08-42bf7e7a6c48 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:35.292840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:35.293497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:35.293860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:35.294196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:35.295063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:35.295397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.324258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e73d2-6857-45fc-843d-3fb7bcff82c4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.337707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 672/1343] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:35.344253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:35.354585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff5867-1fb3-4b71-8470-bb4770ad4c99 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:35.359320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:35.360255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:35.360640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:35.360972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] PATH_INFO: `/v3/projects/344839d838b6439a85fb04b24083ffbf/users/6eb3b883c2164df9b87386f1cecb0972/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:35.376319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344839d838b6439a85fb04b24083ffbf, user_id=6eb3b883c2164df9b87386f1cecb0972, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:35.408487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e668e-67a8-4bd3-83e9-331044ae86b1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:35.449623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 672/1344] 10.222.0.18 () {58 vars in 1451 bytes} [Sat Aug 21 12:12:35 2021] PUT /identity/v3/projects/344839d838b6439a85fb04b24083ffbf/users/6eb3b883c2164df9b87386f1cecb0972/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:12:37.591577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a3d26-ac4f-418e-8cba-0d71897797f9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.592134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a3d26-ac4f-418e-8cba-0d71897797f9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.592254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a3d26-ac4f-418e-8cba-0d71897797f9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.594179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 673/1345] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:37.599935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.600283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.600615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.624279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:37.625478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:37.691190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 673/1346] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:37.715206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.715579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.715937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.739404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:37.740643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:37.748681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 674/1347] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:37.754635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:37.764665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188cbb8-cfa7-4c0f-a848-d0ce89ab8f74 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:37.768988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:37.769782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.770156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.770483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.782076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Aug 21 12:12:37.789253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 12:12:37.790549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 674/1348] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Aug 21 12:12:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:37.797551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:37.807956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60c9b2-f58b-422d-b521-b4dbe615b9d1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:37.812637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:37.813373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.813745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.814106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.814900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:37.815288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:37.847369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:37.857664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 675/1349] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Aug 21 12:12:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:37.863628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:37.873952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd847f31-fb15-4d22-a4e9-d59b8cc76bb2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:37.878237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:37.879025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.879360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.879692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.891228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:37.920431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:37.939730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:37.940873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 675/1350] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:37.947232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:37.957832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121316f-1bf1-4ea8-b25d-90866827622c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:37.962322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:37.963022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:37.963366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:37.963697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:37.964539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:37.964891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:37.996397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.012252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 676/1351] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:38.018386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.028383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191f587-91b3-4238-bda2-99bced467c87 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.032750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.033558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.033925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.034261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.048071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.077228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.096713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 12:12:38.097930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 676/1352] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/users/placement => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:38.104441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.114577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735bf63-6df5-4da6-a7e0-8e57b5f307d3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.119050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.120288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.120650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.121003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.121956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:38.122339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.151172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.183693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 677/1353] 10.222.0.18 () {56 vars in 1155 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:38.189619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.199505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf38a5f-808b-40ce-8bbe-dbfd2d9583a7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.203852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.204491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.204828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.205160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.214142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.242439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.252001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 677/1354] 10.222.0.18 () {58 vars in 1315 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:12:38.258292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.268874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72904a91-c37c-4b9a-97c0-4277ea59dcfc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.273345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.274212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.274552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.274932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.287953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.318458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.339030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 12:12:38.340387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 678/1355] 10.222.0.18 () {56 vars in 1120 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:38.346127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.355040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d393b9-e04a-47f9-b791-a919ec311bcc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.359348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.359992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.360326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.360655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.361411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:38.361756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.390597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.403033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 678/1356] 10.222.0.18 () {56 vars in 1121 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:38.408726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.418552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b4b3c-9056-4181-9e5e-170e294da47f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.422884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.423651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.423984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.424313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.434197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.462836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.477458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 12:12:38.478699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 679/1357] 10.222.0.18 () {56 vars in 1123 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:38.484450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.495186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938b3ee-bea6-4369-9f0e-cc3e8b4e863f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.499552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.500315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.500656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.500990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.501845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:38.502211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.531264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1595232-7289-4833-89fb-e28fcc5d094e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.544925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 679/1358] 10.222.0.18 () {56 vars in 1160 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:38.550932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:38.561546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a880760-1089-44d6-9234-cc7adb31c675 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:38.565998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:38.566635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:38.566976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:38.567309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:38.568198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] RBAC: Adding query filter params (role.id=90f6703d946e4169827377b5a8ffae62, scope.project.id=344839d838b6439a85fb04b24083ffbf, user.id=6eb3b883c2164df9b87386f1cecb0972) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:38.568561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:38.598008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5a6d9-d7bb-417d-8b06-f3735b3928af admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:38.604627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 680/1359] 10.222.0.18 () {56 vars in 1386 bytes} [Sat Aug 21 12:12:38 2021] GET /identity/v3/role_assignments?user.id=6eb3b883c2164df9b87386f1cecb0972&scope.project.id=344839d838b6439a85fb04b24083ffbf&role.id=90f6703d946e4169827377b5a8ffae62 => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:40.620831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e442-d73e-40d9-a4f0-8e63e67bcdeb None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.621372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e442-d73e-40d9-a4f0-8e63e67bcdeb None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.621498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e442-d73e-40d9-a4f0-8e63e67bcdeb None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.623384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 680/1360] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:40.628907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173763eb-a635-41d0-8722-21411382a33d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.629257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173763eb-a635-41d0-8722-21411382a33d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.629592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173763eb-a635-41d0-8722-21411382a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.653757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-173763eb-a635-41d0-8722-21411382a33d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:40.655005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-173763eb-a635-41d0-8722-21411382a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:40.662319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 681/1361] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:40.684607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.684986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.685348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.711549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:40.713249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:40.720702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 681/1362] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:40.726574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173763eb-a635-41d0-8722-21411382a33d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:40.736681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173763eb-a635-41d0-8722-21411382a33d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:40.741064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:40.741913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.742255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.742586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.743285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:40.771059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:40.783076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 12:12:40.784223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 682/1363] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:12:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:40.791559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:40.801224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcecdbb-177b-48c0-9754-8c93799a7be1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:40.806071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:40.806854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.807196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.807530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.808406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:40.808954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:40.837110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde5b2c-3996-471b-8f9e-a69a57b14f5d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:40.843205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 682/1364] 10.222.0.18 () {56 vars in 1128 bytes} [Sat Aug 21 12:12:40 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:40.849731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:40.861025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aacf5-a23d-4015-986e-37fe045dcf1a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:40.865756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:40.866513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:40.866872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:40.867265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:40.868061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:40.868457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:40.898061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194958-4aa0-4437-89f1-6de44b9ace36 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:40.903398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 683/1365] 10.222.0.18 () {56 vars in 1128 bytes} [Sat Aug 21 12:12:40 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:42.876313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057f1d8-6256-4024-95c9-64079775b4f0 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:42.876837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057f1d8-6256-4024-95c9-64079775b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:42.876970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057f1d8-6256-4024-95c9-64079775b4f0 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:42.878835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 683/1366] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:42.884400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:42.885295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:42.885637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:42.909406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:42.910639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:42.917909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 684/1367] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:42.940183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365b85-0f5c-4f35-95e5-8fc5577dc85b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:42.940527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365b85-0f5c-4f35-95e5-8fc5577dc85b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:42.940859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd365b85-0f5c-4f35-95e5-8fc5577dc85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:42.964515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bd365b85-0f5c-4f35-95e5-8fc5577dc85b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:42.965749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bd365b85-0f5c-4f35-95e5-8fc5577dc85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:42.972938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 684/1368] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:42 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:42.979120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:42.989019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b798c-88ac-4c64-9aa1-f969f0a01658 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:42.993531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:42.994761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:42.995102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:42.995432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:42.996361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:43.024656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fd935-65b7-47f1-8788-5e1e23b97e51 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:43.068222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 685/1369] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Aug 21 12:12:42 2021] POST /identity/v3/services => generated 246 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:12:45.209531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5b03-53eb-4326-9c88-9567d82cc56d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.210065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5b03-53eb-4326-9c88-9567d82cc56d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.210254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f5b03-53eb-4326-9c88-9567d82cc56d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.212065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 685/1370] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:45.217823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.218189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.218548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.246961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:45.248106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:45.267349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 686/1371] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:45 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:45.290740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.291690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.292028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.315685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:45.316919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:45.324459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 686/1372] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:45 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:45.330570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:45.340454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4e74d-1b8a-4526-9705-60503091fd7b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:45.344757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:45.345554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.345924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.346253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.346960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:45.375844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:45.387747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 12:12:45.388887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 687/1373] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:12:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:45.395384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:45.404269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6dbef5-6201-4ea6-84a3-985dd257f520 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:45.408595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:45.409236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.409569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.409959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.410754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:45.411105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:45.439535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:45.445138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 687/1374] 10.222.0.18 () {56 vars in 1128 bytes} [Sat Aug 21 12:12:45 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:45.451401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:45.461004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02877869-71b4-4393-8375-aa5baae16b2e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:45.465463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:45.466127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.466469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.466802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.467636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] RBAC: Adding query filter params (interface=public, service_id=8ad890b22fb74a5eae52a1fbbbe61dad, region_id=RegionOne) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:45.467995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:45.497241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e82a6-98a1-48ed-930d-918d09c4ff66 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:45.502677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 688/1375] 10.222.0.18 () {56 vars in 1263 bytes} [Sat Aug 21 12:12:45 2021] GET /identity/v3/endpoints?service_id=8ad890b22fb74a5eae52a1fbbbe61dad&interface=public®ion_id=RegionOne => generated 194 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:45.508613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:45.518570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c42f-98bd-456c-b294-998f2a263d1f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:45.522882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:45.523512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:45.523844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:45.524168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] PATH_INFO: `/v3/services` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:45.524875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:45.553271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b78f59-c4d8-48ba-a4ec-ff14fb9b967c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:45.561066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 688/1376] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:12:45 2021] GET /identity/v3/services => generated 2430 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:12:47.517827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a92d-b8f0-46b9-af9b-f6caf2711950 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.518353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a92d-b8f0-46b9-af9b-f6caf2711950 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.518509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7a92d-b8f0-46b9-af9b-f6caf2711950 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.520342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 689/1377] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:12:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:12:47.525891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.526242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.526578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.549702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:47.550944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:47.559476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 689/1378] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:47 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:47.581820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.582194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.582557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.606817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:12:47.608058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:12:47.615715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 690/1379] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:12:47 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:12:47.622129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:47.631537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c5e48-5b32-4406-80da-0e14239a7e71 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:47.636457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:47.637259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.637591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.637949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.638646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:47.666451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:47.678124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING keystone.server.flask.application [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 12:12:47.679333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 690/1380] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Aug 21 12:12:47 2021] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 12:12:47.686238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:47.695493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61c09a-139b-4200-894c-a56654c301a4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:47.700655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:47.701307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.701647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.702033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] PATH_INFO: `/v3/services` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.702831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:12:47.703185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:47.732395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e59dc-1127-4bba-9f51-07c393c38b4b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:47.738028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 691/1381] 10.222.0.18 () {56 vars in 1128 bytes} [Sat Aug 21 12:12:47 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:12:47.743659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:12:47.753830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4fcce-2e78-47e5-b659-e7ef2bbd6b3c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:12:47.758292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:12:47.758921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:12:47.759254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:12:47.759580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:12:47.760337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:12:47.787972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2997a-5bbb-430f-b03b-6a2d86ce23b1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:12:47.839991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 691/1382] 10.222.0.18 () {60 vars in 1156 bytes} [Sat Aug 21 12:12:47 2021] POST /identity/v3/endpoints => generated 331 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:18:15.515063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6af37-71c1-4a6f-85db-1bdb80a9784e None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:15.515647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6af37-71c1-4a6f-85db-1bdb80a9784e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:15.515762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6af37-71c1-4a6f-85db-1bdb80a9784e None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:15.517593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 692/1383] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:18:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:18:15.523143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80578-f270-4c08-9a1c-5a8a8b82f1cc None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:15.523489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80578-f270-4c08-9a1c-5a8a8b82f1cc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:15.523825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80578-f270-4c08-9a1c-5a8a8b82f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:15.613941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4ae80578-f270-4c08-9a1c-5a8a8b82f1cc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:15.615767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4ae80578-f270-4c08-9a1c-5a8a8b82f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:15.729227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 692/1384] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:18:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:15.756740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c229-843f-4b63-a30c-d9a6e9c4d773 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:15.757086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c229-843f-4b63-a30c-d9a6e9c4d773 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:15.757418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3c229-843f-4b63-a30c-d9a6e9c4d773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:15.848732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b9e3c229-843f-4b63-a30c-d9a6e9c4d773 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:15.850407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b9e3c229-843f-4b63-a30c-d9a6e9c4d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:15.960337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 693/1385] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:18:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:15.997030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:15.997388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:15.997727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:15.999606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 693/1386] 10.222.0.18 () {54 vars in 945 bytes} [Sat Aug 21 12:18:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:18:16.005067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777107d-7ed6-4839-85ea-213621ae0d17 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:16.005437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777107d-7ed6-4839-85ea-213621ae0d17 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:16.005773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777107d-7ed6-4839-85ea-213621ae0d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:16.106434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4777107d-7ed6-4839-85ea-213621ae0d17 None None] MFA Rules not processed for user `ae4fdee19f3c4821b3831f77f2273d52`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:16.107566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4777107d-7ed6-4839-85ea-213621ae0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:16.195768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 694/1387] 10.222.0.18 () {58 vars in 1043 bytes} [Sat Aug 21 12:18:16 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:16.203705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:18:16.205429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:16.335506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5688b74-5c8a-4edf-abca-bf1a713c9ed6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:18:16.423391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:18:16.424046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:16.424388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:16.424721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:16.426432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:16.555938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:18:16.584690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8341400-ccdc-4e35-8a14-6624f09c108d service glance] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:18:16.606871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 694/1388] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:18:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:18:17.245067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524b8a-164f-43c8-911b-4a6ac3c0eafe None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:17.245419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524b8a-164f-43c8-911b-4a6ac3c0eafe None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:17.245851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86524b8a-164f-43c8-911b-4a6ac3c0eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:17.410507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-86524b8a-164f-43c8-911b-4a6ac3c0eafe None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:17.412272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-86524b8a-164f-43c8-911b-4a6ac3c0eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:17.512210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 695/1389] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:18:17 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:17.557371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:17.557846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:17.558065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:17.559906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 695/1390] 10.222.0.18 () {54 vars in 931 bytes} [Sat Aug 21 12:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:18:17.566801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58ec5-7049-4bf6-9f25-e70f4b512797 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:17.567153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58ec5-7049-4bf6-9f25-e70f4b512797 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:17.567489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf58ec5-7049-4bf6-9f25-e70f4b512797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:17.667284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5cf58ec5-7049-4bf6-9f25-e70f4b512797 None None] MFA Rules not processed for user `548a40dbc77541399c25dd99e88ec169`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:17.668481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5cf58ec5-7049-4bf6-9f25-e70f4b512797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:17.795393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 696/1391] 10.222.0.18 () {58 vars in 1029 bytes} [Sat Aug 21 12:18:17 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:17.806434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:18:17.808005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:17.966059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8d5ad-32bf-4619-9fa2-099873d0ed79 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:18:18.090021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:18:18.090607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:18.090954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:18.091287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:18.093015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:18.195103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:18:18.222995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d42e9-dfb9-4944-b281-cb393ac299b5 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:18:18.231235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 696/1392] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:18:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:18:59.324678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc49e-62d8-40da-aa26-c2666f5e6a2d None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:59.325583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc49e-62d8-40da-aa26-c2666f5e6a2d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:59.326123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bc49e-62d8-40da-aa26-c2666f5e6a2d None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:59.332290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 697/1393] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:18:59 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:18:59.334292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:59.334826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:59.335311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:59.485577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:59.487632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:59.714177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 697/1394] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:18:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:59.736908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae5ba-7d49-4956-ba06-f05f0844adf1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:59.737364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae5ba-7d49-4956-ba06-f05f0844adf1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:59.737907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ae5ba-7d49-4956-ba06-f05f0844adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:59.767370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6d7ae5ba-7d49-4956-ba06-f05f0844adf1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:18:59.768851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6d7ae5ba-7d49-4956-ba06-f05f0844adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:18:59.784594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 698/1395] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:18:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:18:59.785716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:18:59.797977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7deeaa-7067-42c5-9c2b-2917a73e5550 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:18:59.804203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:18:59.805152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:18:59.805629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:18:59.806166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:18:59.807153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:18:59.838845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3c5b1-0041-41c8-9d73-9e5ff435af53 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:18:59.875074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 698/1396] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:18:59 2021] GET /identity/v3/projects => generated 2553 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:19:01.935899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3172-b1fa-409b-b310-9f89337795d8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:01.936659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3172-b1fa-409b-b310-9f89337795d8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:01.936659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c3172-b1fa-409b-b310-9f89337795d8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:01.938399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 699/1397] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:01.944845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9faa-4c60-4ec4-be42-891de7514053 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:01.945228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9faa-4c60-4ec4-be42-891de7514053 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:01.945564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd9faa-4c60-4ec4-be42-891de7514053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:01.970512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-53bd9faa-4c60-4ec4-be42-891de7514053 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:01.971740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-53bd9faa-4c60-4ec4-be42-891de7514053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:01.979391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 699/1398] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:02.004357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40e38-bed1-4ecb-912d-131a40777f41 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:02.004703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40e38-bed1-4ecb-912d-131a40777f41 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:02.005043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40e38-bed1-4ecb-912d-131a40777f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:02.029000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-63a40e38-bed1-4ecb-912d-131a40777f41 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:02.030277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-63a40e38-bed1-4ecb-912d-131a40777f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:02.037780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 700/1399] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:02.074074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498e99-a79c-45ab-b8b3-5371486e96a5 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:02.074469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498e99-a79c-45ab-b8b3-5371486e96a5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:02.074812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df498e99-a79c-45ab-b8b3-5371486e96a5 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:02.076675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 700/1400] 10.222.0.18 () {54 vars in 952 bytes} [Sat Aug 21 12:19:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:02.082595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05394c4b-d347-4f51-a7b9-c0019c10ae61 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:02.082942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05394c4b-d347-4f51-a7b9-c0019c10ae61 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:02.083327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05394c4b-d347-4f51-a7b9-c0019c10ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:02.175470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-05394c4b-d347-4f51-a7b9-c0019c10ae61 None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:02.176678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-05394c4b-d347-4f51-a7b9-c0019c10ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:02.264993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 701/1401] 10.222.0.18 () {58 vars in 1050 bytes} [Sat Aug 21 12:19:02 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:02.274154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df498e99-a79c-45ab-b8b3-5371486e96a5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:02.285049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df498e99-a79c-45ab-b8b3-5371486e96a5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:02.289142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:02.289732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:02.290101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:02.290432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:02.299819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:02.328238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f50a4-5ce5-4585-8b42-523b57399e87 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:02.337694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 701/1402] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:04.760023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffed0-be68-4abe-9f89-98c896340d07 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:04.760585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffed0-be68-4abe-9f89-98c896340d07 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:04.760709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffed0-be68-4abe-9f89-98c896340d07 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:04.762539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 702/1403] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:04.768174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:04.768524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:04.768862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:04.793306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:04.794542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:04.802172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 702/1404] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:04.827454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723013-db88-4462-98f6-d308f5d50cd1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:04.827809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723013-db88-4462-98f6-d308f5d50cd1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:04.828149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b723013-db88-4462-98f6-d308f5d50cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:04.853487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6b723013-db88-4462-98f6-d308f5d50cd1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:04.854734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6b723013-db88-4462-98f6-d308f5d50cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:04.862161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 703/1405] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:04.883130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:04.892933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db306847-fc9b-4c89-9b70-2dd4a321b930 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:04.896997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:04.897645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:04.898012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:04.898345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:04.907505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:04.936028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73593f3e-98c5-4da5-8bb2-f283ee5a153d service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:04.945437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 703/1406] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:07.641049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575b0-ee06-453d-94e8-2d7a2268fb12 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:07.641582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575b0-ee06-453d-94e8-2d7a2268fb12 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:07.641700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953575b0-ee06-453d-94e8-2d7a2268fb12 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:07.643583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 704/1407] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:07.649868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:07.650218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:07.650549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:07.675683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:07.676887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:07.684386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 704/1408] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:07.713366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:07.713710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:07.714077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:07.736583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:07.737763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:07.745502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 705/1409] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:07.759952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:07.769855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10e3df-327a-4993-bf28-0d081267482b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:07.774397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:07.775271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:07.775612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:07.775947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:07.788830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:07.818730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f5237c-3222-47df-ac55-da995d186d45 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:07.820464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 705/1410] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:19:07 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:19:07.835532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:07.845096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f188c-834f-4aa6-bc88-6c29f1fe4a28 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:07.848542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:07.849182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:07.849517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:07.849868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:07.858906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:07.888596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5335ed6-2c96-44f5-a65e-ad52f22ce7b6 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:07.898961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 706/1411] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:10.665190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23485da-d615-4421-a6bf-eddb2a5f79dc None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:10.665717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23485da-d615-4421-a6bf-eddb2a5f79dc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:10.665849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23485da-d615-4421-a6bf-eddb2a5f79dc None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:10.667661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 706/1412] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:10.673425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:10.673779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:10.674150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:10.698449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:10.699696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:10.707149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 707/1413] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:10.735757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:10.736103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:10.736436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:10.759735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:10.760939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:10.768350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 707/1414] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:10.782644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:10.792822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebdaa2-fc9f-435a-9020-0886ad4825ec None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:10.797467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:10.798358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:10.798699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:10.799032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:10.800225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:10.828275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7b481-cef7-4e7d-8a72-b60b0a087cff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:10.829939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 708/1415] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:19:10 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:19:10.842936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:10.853125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd57899-745d-460a-bc35-6c3cb46d56ee None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:10.856624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:10.857265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:10.857603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:10.857975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:10.867161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:10.894970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202afa6f-5091-49c1-bd95-8853d632083f service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:10.905168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 708/1416] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:13.830306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d304-5e08-474a-a55a-94eebd22c47a None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:13.830865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d304-5e08-474a-a55a-94eebd22c47a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:13.830960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161d304-5e08-474a-a55a-94eebd22c47a None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:13.833297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 709/1417] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:13.838909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:13.839261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:13.839600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:13.863954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:13.865216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:13.882065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 709/1418] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:13.898404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646912cd-9ede-402c-bed9-105db5389e85 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:13.898835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646912cd-9ede-402c-bed9-105db5389e85 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:13.899267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646912cd-9ede-402c-bed9-105db5389e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:13.924152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-646912cd-9ede-402c-bed9-105db5389e85 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:13.925494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-646912cd-9ede-402c-bed9-105db5389e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:13.933006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 710/1419] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:13.951671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:13.962701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17557d63-2230-4d99-a5ac-6950059d474c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:13.967158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:13.967420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:13.967760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:13.968492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:13.978662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:14.006986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006e7e4-1f28-4568-950f-5db5e94098ff service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:14.017152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 710/1420] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:16.085721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58ae6e-17ef-447e-adee-b51b88bdd482 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.086265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58ae6e-17ef-447e-adee-b51b88bdd482 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.086452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58ae6e-17ef-447e-adee-b51b88bdd482 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.088310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 711/1421] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:16.093816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183812-963c-48d1-8d98-c47d09039fe5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.094206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183812-963c-48d1-8d98-c47d09039fe5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.094547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee183812-963c-48d1-8d98-c47d09039fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.119356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ee183812-963c-48d1-8d98-c47d09039fe5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:16.120577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ee183812-963c-48d1-8d98-c47d09039fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:16.128257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 711/1422] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:16.153242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef262b-212a-4d8d-8c3a-d114041a78a6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.153592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef262b-212a-4d8d-8c3a-d114041a78a6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.153969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef262b-212a-4d8d-8c3a-d114041a78a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.177712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-81ef262b-212a-4d8d-8c3a-d114041a78a6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:16.178967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-81ef262b-212a-4d8d-8c3a-d114041a78a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:16.186402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 712/1423] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:16.221686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae95cf9-dc4b-44f3-b787-feffd57b5e9a None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.222082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae95cf9-dc4b-44f3-b787-feffd57b5e9a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.222413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae95cf9-dc4b-44f3-b787-feffd57b5e9a None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.224248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 712/1424] 10.222.0.18 () {54 vars in 952 bytes} [Sat Aug 21 12:19:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:16.232318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e167-af4c-4c6c-9924-059187b942ca None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.232709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e167-af4c-4c6c-9924-059187b942ca None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.233053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222e167-af4c-4c6c-9924-059187b942ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.258825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f222e167-af4c-4c6c-9924-059187b942ca None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:16.259981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f222e167-af4c-4c6c-9924-059187b942ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:16.266174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 713/1425] 10.222.0.18 () {58 vars in 1050 bytes} [Sat Aug 21 12:19:16 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:16.275165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae95cf9-dc4b-44f3-b787-feffd57b5e9a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:16.286211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae95cf9-dc4b-44f3-b787-feffd57b5e9a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:16.290009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:16.290665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:16.291009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:16.291345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:16.301240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:16.330097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be1651-7d12-4458-a01b-b399c3d3292f service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:16.339574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 713/1426] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:18.755140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565773-d33b-4f33-8c45-7f997126d3e0 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:18.755643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565773-d33b-4f33-8c45-7f997126d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:18.755770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62565773-d33b-4f33-8c45-7f997126d3e0 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:18.757630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 714/1427] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:18.763317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:18.763668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:18.764001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:18.787741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:18.788932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:18.796424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 714/1428] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:18.821879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:18.822192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:18.822523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:18.845072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:18.846303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:18.854088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 715/1429] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:18.868639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:18.878623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307583-c6a5-41c8-8138-ea4e21d3b584 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:18.883504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:18.884576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:18.885165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:18.885595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:18.886905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:18.916071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629645ad-1180-48e8-8a5d-af77dbd86c16 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:18.917810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 715/1430] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:19:18 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:19:18.933165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:18.942943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edee95-4c35-416e-9faf-572bc5d23849 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:18.946412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:18.947054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:18.947390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:18.947719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:18.957357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:18.986420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58253965-7821-4dda-8710-54f9f22d058d service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:18.998617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 716/1431] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:21.630233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24660b-8396-40e9-9610-11cb39302753 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:21.630763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24660b-8396-40e9-9610-11cb39302753 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:21.630879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24660b-8396-40e9-9610-11cb39302753 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:21.632705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 716/1432] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:21.638366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:21.638754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:21.639088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:21.662841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:21.664033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:21.671553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 717/1433] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:21.696139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bb64-ebb4-4e42-a8ea-eeff1a97c08c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:21.696485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bb64-ebb4-4e42-a8ea-eeff1a97c08c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:21.696823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072bb64-ebb4-4e42-a8ea-eeff1a97c08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:21.720203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1072bb64-ebb4-4e42-a8ea-eeff1a97c08c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:21.721394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1072bb64-ebb4-4e42-a8ea-eeff1a97c08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:21.729237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 717/1434] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:21.748178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:21.757966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c628157-8000-4de9-823e-6c8d2e98b056 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:21.761453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:21.762136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:21.762476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:21.762810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:21.772022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:21.800449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6eb89c-e8a8-49a0-8eaf-8e13bd068d2e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:21.810487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 718/1435] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:23.869940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249e63-033f-4426-9787-47093d467da0 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:23.870477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249e63-033f-4426-9787-47093d467da0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:23.870649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b249e63-033f-4426-9787-47093d467da0 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:23.872547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 718/1436] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:23.878244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:23.878632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:23.878973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:23.902424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:23.903632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:23.911405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 719/1437] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:23.939819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6fde-abb7-4d1c-8d3c-7b802668fdac None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:23.940167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6fde-abb7-4d1c-8d3c-7b802668fdac None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:23.940505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6fde-abb7-4d1c-8d3c-7b802668fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:23.963742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a1b6fde-abb7-4d1c-8d3c-7b802668fdac None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:23.964955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a1b6fde-abb7-4d1c-8d3c-7b802668fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:23.973820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 719/1438] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:23.993756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:24.003631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ab1c-1ce0-4a2c-86f7-8b3dd644acf0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:24.007267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:24.007989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:24.008578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:24.008702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:24.018073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:24.046687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0562d5-fe30-4674-bb02-46eead38b122 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:24.056778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 720/1439] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:26.898535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0ad42-a844-415e-9549-586138643c79 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:26.899097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0ad42-a844-415e-9549-586138643c79 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:26.899208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b0ad42-a844-415e-9549-586138643c79 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:26.901098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 720/1440] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:26.906691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:26.907044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:26.907380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:26.932413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:26.933661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:26.941157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 721/1441] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:26.965622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b64d-b713-45d0-add6-665c1bbe749a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:26.966010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b64d-b713-45d0-add6-665c1bbe749a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:26.966348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358b64d-b713-45d0-add6-665c1bbe749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:26.991071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6358b64d-b713-45d0-add6-665c1bbe749a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:26.992292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6358b64d-b713-45d0-add6-665c1bbe749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:26.999820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 721/1442] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:27.020349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:27.030502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642601-b540-4bf9-a126-f5e3d2f097e5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:27.033972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:27.034617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:27.034975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:27.035278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:27.045316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:27.073686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7dfa1-82f9-40b8-b3e5-7bf330cec25b service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:27.083400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 722/1443] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:31.938643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21926c-ddb3-4931-a38f-bf26d13bd3b9 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:31.939152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21926c-ddb3-4931-a38f-bf26d13bd3b9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:31.939261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21926c-ddb3-4931-a38f-bf26d13bd3b9 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:31.941050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 722/1444] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:31.946741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:31.947096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:31.947439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:31.971380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:31.972609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:31.982624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 723/1445] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:32.016815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5328d-2a87-4aad-b0bb-a50539a4b5f6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:32.017167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5328d-2a87-4aad-b0bb-a50539a4b5f6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:32.017505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5328d-2a87-4aad-b0bb-a50539a4b5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:32.042578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eac5328d-2a87-4aad-b0bb-a50539a4b5f6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:32.043800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eac5328d-2a87-4aad-b0bb-a50539a4b5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:32.051755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 723/1446] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:32.071651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:32.081642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df839c4-7d62-4750-a86f-ec27d4072df2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:32.086153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:32.086804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:32.087284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:32.087827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:32.101029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:32.129588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fdc5c-4cd2-4f8a-b234-ffeb0b02d45d service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:32.140401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 724/1447] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:35.195881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d9353-165b-4134-be7f-632c293a9087 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:35.196453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d9353-165b-4134-be7f-632c293a9087 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:35.196570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d9353-165b-4134-be7f-632c293a9087 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:35.198570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 724/1448] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:35.204284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:35.204635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:35.204971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:35.229094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:35.230409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:35.238457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 725/1449] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:35.264270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24336b3-f695-4420-8f44-e6f529baf3d9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:35.264617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24336b3-f695-4420-8f44-e6f529baf3d9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:35.264954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24336b3-f695-4420-8f44-e6f529baf3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:35.288540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f24336b3-f695-4420-8f44-e6f529baf3d9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:35.289738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f24336b3-f695-4420-8f44-e6f529baf3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:35.297382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 725/1450] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:35.317453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:35.327254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81651b-b01c-46e1-9386-bed35e610b60 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:35.330785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:35.331438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:35.331777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:35.332111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:35.341441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:35.370415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16067c-cb59-400d-9243-20a2d25f8516 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:35.379961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 726/1451] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:40.041993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9c4-abdd-4ecc-99b8-3e3ad6ba9d75 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:40.042460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9c4-abdd-4ecc-99b8-3e3ad6ba9d75 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:40.042571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2db9c4-abdd-4ecc-99b8-3e3ad6ba9d75 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:40.044822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 726/1452] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:40.050891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:40.052619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:40.052965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:40.079163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:40.080327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:40.088317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 727/1453] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:40.113821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f548-51a2-431f-a7ba-8a10de20e36a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:40.114193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f548-51a2-431f-a7ba-8a10de20e36a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:40.114537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941f548-51a2-431f-a7ba-8a10de20e36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:40.138465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4941f548-51a2-431f-a7ba-8a10de20e36a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:40.139675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4941f548-51a2-431f-a7ba-8a10de20e36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:40.147841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 727/1454] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:40.168851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:40.179530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ead784-8954-424b-9966-4209d0f718c4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:40.183156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:40.183863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:40.184209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:40.184547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:40.194858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:40.223799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c680a-2da0-46b8-b554-14265ff55c4a service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:40.234817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 728/1455] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:44.778347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f05-04f6-4c3b-ab75-2a7144fcddd8 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:44.778871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f05-04f6-4c3b-ab75-2a7144fcddd8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:44.779007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2f05-04f6-4c3b-ab75-2a7144fcddd8 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:44.780814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 728/1456] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:19:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:44.787368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853105-715e-409a-b249-2e4c3742717c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:44.787722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853105-715e-409a-b249-2e4c3742717c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:44.788067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6853105-715e-409a-b249-2e4c3742717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:44.894611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e6853105-715e-409a-b249-2e4c3742717c None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:44.899470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e6853105-715e-409a-b249-2e4c3742717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:45.005010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 729/1457] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:19:44 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:45.566732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74743-d479-49e6-863a-f089edab2a4a None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:45.567428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74743-d479-49e6-863a-f089edab2a4a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:45.567933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c74743-d479-49e6-863a-f089edab2a4a None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:45.570219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 729/1458] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:19:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:45.575750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67f16-c5f8-44bb-b9d6-a7faf4d7554b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:45.576104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67f16-c5f8-44bb-b9d6-a7faf4d7554b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:45.576448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe67f16-c5f8-44bb-b9d6-a7faf4d7554b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:45.631017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cbe67f16-c5f8-44bb-b9d6-a7faf4d7554b None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:45.634836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cbe67f16-c5f8-44bb-b9d6-a7faf4d7554b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:45.651859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 730/1459] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:19:45 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:48.758461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce3e0-860b-4dcd-8f88-f8f1e359bd1b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:48.758999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce3e0-860b-4dcd-8f88-f8f1e359bd1b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:48.759114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce3e0-860b-4dcd-8f88-f8f1e359bd1b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:48.761331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 730/1460] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:19:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:48.766645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad0c6-6950-44cb-997e-1803b313a783 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:48.767073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad0c6-6950-44cb-997e-1803b313a783 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:48.767490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad0c6-6950-44cb-997e-1803b313a783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:48.791971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f0ad0c6-6950-44cb-997e-1803b313a783 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:48.793263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f0ad0c6-6950-44cb-997e-1803b313a783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:48.802376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 731/1461] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:19:48 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:49.978582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a5a03-8a91-4236-a3dc-8a70abd17d5b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:49.979143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a5a03-8a91-4236-a3dc-8a70abd17d5b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:49.979256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a5a03-8a91-4236-a3dc-8a70abd17d5b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:49.981052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 731/1462] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:19:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:49.987295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4462dc-0cc7-4f93-b435-0aa3d85ff588 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:49.987751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4462dc-0cc7-4f93-b435-0aa3d85ff588 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:49.988166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4462dc-0cc7-4f93-b435-0aa3d85ff588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:50.012098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0c4462dc-0cc7-4f93-b435-0aa3d85ff588 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:50.013413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0c4462dc-0cc7-4f93-b435-0aa3d85ff588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:50.022076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 732/1463] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:19:49 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:53.608776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea55f6-e490-4d6f-a2dd-27593543ee29 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:53.609320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea55f6-e490-4d6f-a2dd-27593543ee29 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:53.609413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea55f6-e490-4d6f-a2dd-27593543ee29 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:53.611278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 732/1464] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:53.616746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd217a-8cf9-44c5-be53-5233155ba4a1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:53.617131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd217a-8cf9-44c5-be53-5233155ba4a1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:53.617463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd217a-8cf9-44c5-be53-5233155ba4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:53.640311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c0bd217a-8cf9-44c5-be53-5233155ba4a1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:53.641512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0bd217a-8cf9-44c5-be53-5233155ba4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:53.649367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 733/1465] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:53.791990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c43f-ee68-440f-8782-8648d3c688df None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:53.792333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c43f-ee68-440f-8782-8648d3c688df None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:53.792676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c43f-ee68-440f-8782-8648d3c688df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:53.817819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0ff0c43f-ee68-440f-8782-8648d3c688df None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:53.819040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0ff0c43f-ee68-440f-8782-8648d3c688df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:53.826396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 733/1466] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:53.846348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294d04-c991-4f00-8d02-4c6d5fdb72fa None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:53.846693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294d04-c991-4f00-8d02-4c6d5fdb72fa None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:53.847629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294d04-c991-4f00-8d02-4c6d5fdb72fa None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:53.849569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 734/1467] 10.222.0.18 () {54 vars in 948 bytes} [Sat Aug 21 12:19:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:53.855131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee551c7-c72b-434b-97ee-01520ddb4491 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:53.855476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee551c7-c72b-434b-97ee-01520ddb4491 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:53.855810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee551c7-c72b-434b-97ee-01520ddb4491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:53.927265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1ee551c7-c72b-434b-97ee-01520ddb4491 None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:53.928490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ee551c7-c72b-434b-97ee-01520ddb4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:54.026427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 734/1468] 10.222.0.18 () {58 vars in 1046 bytes} [Sat Aug 21 12:19:53 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:54.034771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b294d04-c991-4f00-8d02-4c6d5fdb72fa None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:54.048874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b294d04-c991-4f00-8d02-4c6d5fdb72fa None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:54.054081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:54.054724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:54.055064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:54.055394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:54.063800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:54.092650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfbf94f-fa58-4510-847b-38dbd5887de1 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:54.102170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 735/1469] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:56.275211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447219-3036-4068-8e3a-1582be230a62 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.275731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447219-3036-4068-8e3a-1582be230a62 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.275844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd447219-3036-4068-8e3a-1582be230a62 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.277697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 735/1470] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:56.283168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188ef77-8a47-4714-baad-3e191af93cc0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.283519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188ef77-8a47-4714-baad-3e191af93cc0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.283853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188ef77-8a47-4714-baad-3e191af93cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.307374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9188ef77-8a47-4714-baad-3e191af93cc0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:56.308566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9188ef77-8a47-4714-baad-3e191af93cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:56.316408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 736/1471] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:56.458865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cdf0-5530-4129-b3d0-ef3c83f4ed06 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.459245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cdf0-5530-4129-b3d0-ef3c83f4ed06 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.459585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516cdf0-5530-4129-b3d0-ef3c83f4ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.482931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7516cdf0-5530-4129-b3d0-ef3c83f4ed06 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:56.484146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7516cdf0-5530-4129-b3d0-ef3c83f4ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:56.492020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 736/1472] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:56.512874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2304d-0f93-48fe-b9cf-3d10ba246242 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.513220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2304d-0f93-48fe-b9cf-3d10ba246242 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.513557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2304d-0f93-48fe-b9cf-3d10ba246242 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.515421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 737/1473] 10.222.0.18 () {54 vars in 948 bytes} [Sat Aug 21 12:19:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:19:56.520958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d3e5-d1d6-4b14-852e-dd5252ffde18 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.521299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d3e5-d1d6-4b14-852e-dd5252ffde18 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.521632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d3e5-d1d6-4b14-852e-dd5252ffde18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.545101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2e06d3e5-d1d6-4b14-852e-dd5252ffde18 None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:56.546259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2e06d3e5-d1d6-4b14-852e-dd5252ffde18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:56.555211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 737/1474] 10.222.0.18 () {58 vars in 1046 bytes} [Sat Aug 21 12:19:56 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:56.563297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2304d-0f93-48fe-b9cf-3d10ba246242 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:56.577655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2304d-0f93-48fe-b9cf-3d10ba246242 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:56.582824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:56.583450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:56.583783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:56.584113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:56.592393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:56.620628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a405f-6969-4a7f-ad14-0360894835e0 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:56.630582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 738/1475] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:19:59.007662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189628-485b-4595-ad68-2f9f96291630 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:59.008103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189628-485b-4595-ad68-2f9f96291630 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:59.008320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8189628-485b-4595-ad68-2f9f96291630 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:59.010397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 738/1476] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:19:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:19:59.015755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:59.016145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:59.016481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:59.042352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:59.043552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:59.051932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 739/1477] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:59.192416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdba11-3edd-4068-bedf-6c6fec3593e3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:59.192753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdba11-3edd-4068-bedf-6c6fec3593e3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:59.193087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdba11-3edd-4068-bedf-6c6fec3593e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:59.216680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8dbdba11-3edd-4068-bedf-6c6fec3593e3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:19:59.217904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8dbdba11-3edd-4068-bedf-6c6fec3593e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:19:59.225641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 739/1478] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:19:59 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:19:59.237053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:19:59.249181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495dd53-23af-4537-b1fa-f1031a8f375a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:19:59.257193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:19:59.257912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:19:59.258259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:19:59.258592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:19:59.268255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:19:59.297033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788e03-480a-4126-99b0-c637550585eb service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:19:59.306673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 740/1479] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:19:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:01.566650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891f47-80d5-4571-91be-076abb2960f6 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:01.567214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891f47-80d5-4571-91be-076abb2960f6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:01.567318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a891f47-80d5-4571-91be-076abb2960f6 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:01.569119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 740/1480] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:01.574827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947708-8c86-428e-b280-cee9c93be99e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:01.575177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947708-8c86-428e-b280-cee9c93be99e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:01.575551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54947708-8c86-428e-b280-cee9c93be99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:01.599253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-54947708-8c86-428e-b280-cee9c93be99e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:01.600442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-54947708-8c86-428e-b280-cee9c93be99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:01.607749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 741/1481] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:01.750586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b675f-21ae-44f4-b9d0-cc0998658b89 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:01.750935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b675f-21ae-44f4-b9d0-cc0998658b89 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:01.751272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b675f-21ae-44f4-b9d0-cc0998658b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:01.774692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f65b675f-21ae-44f4-b9d0-cc0998658b89 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:01.775886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f65b675f-21ae-44f4-b9d0-cc0998658b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:01.783119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 741/1482] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:01.795360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54947708-8c86-428e-b280-cee9c93be99e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:01.807385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54947708-8c86-428e-b280-cee9c93be99e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:01.812709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:01.813400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:01.813740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:01.814126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:01.822548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:01.851312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13757f-66eb-43b6-af20-b57a16ac46dc service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:01.860689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 742/1483] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:03.992663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca653-ad03-49ac-bf08-a365ff4f3eee None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:03.993240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca653-ad03-49ac-bf08-a365ff4f3eee None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:03.993359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ca653-ad03-49ac-bf08-a365ff4f3eee None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:03.995394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 742/1484] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:04.001702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:04.002181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:04.002622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:04.027209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:04.028421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:04.035890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 743/1485] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:04.177997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57baa7-3f71-4304-a9cd-78a9b0f85c64 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:04.178343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57baa7-3f71-4304-a9cd-78a9b0f85c64 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:04.178709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57baa7-3f71-4304-a9cd-78a9b0f85c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:04.202207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f57baa7-3f71-4304-a9cd-78a9b0f85c64 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:04.203413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f57baa7-3f71-4304-a9cd-78a9b0f85c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:04.210807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 743/1486] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:04.222380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:04.234658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300585-105b-44d1-9f9e-a692badb8f6f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:04.240463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:04.241111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:04.241452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:04.241821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:04.250371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:04.278790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f94c5-c768-4ce3-8b96-716f1a566a90 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:04.288370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 744/1487] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:06.424755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a213d-04bf-42e1-badc-d64767a2dae2 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:06.425275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a213d-04bf-42e1-badc-d64767a2dae2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:06.425431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a213d-04bf-42e1-badc-d64767a2dae2 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:06.427344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 744/1488] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:06.432800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:06.433153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:06.433489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:06.457932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:06.459140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:06.466572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 745/1489] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:06.607652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88450e55-da84-40cc-b906-310a14ac8652 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:06.607997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88450e55-da84-40cc-b906-310a14ac8652 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:06.608334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88450e55-da84-40cc-b906-310a14ac8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:06.633282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-88450e55-da84-40cc-b906-310a14ac8652 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:06.634494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-88450e55-da84-40cc-b906-310a14ac8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:06.642151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 745/1490] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:06.654074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:06.666455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c732c-d5da-4d31-a631-11665277775f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:06.672042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:06.672701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:06.673045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:06.673383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:06.682020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:06.710823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857e25c-206b-42de-b196-4e2bab053af6 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:06.720284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 746/1491] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:08.885046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa34a3-76e3-4e99-80cb-ac2a3f3161d1 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:08.885596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa34a3-76e3-4e99-80cb-ac2a3f3161d1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:08.885719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa34a3-76e3-4e99-80cb-ac2a3f3161d1 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:08.887624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 746/1492] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:08.893067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:08.894121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:08.894443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:08.918259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:08.919748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:08.927176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 747/1493] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:09.067539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44838-ed98-47ce-9777-768ed2f9ea61 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:09.067889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44838-ed98-47ce-9777-768ed2f9ea61 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:09.068226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d44838-ed98-47ce-9777-768ed2f9ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:09.091881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-34d44838-ed98-47ce-9777-768ed2f9ea61 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:09.093092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-34d44838-ed98-47ce-9777-768ed2f9ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:09.100585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 747/1494] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:09.112076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:09.123966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d78bb-c5b4-49a1-a5f4-a41f8992039b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:09.130844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:09.131488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:09.131827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:09.132156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:09.140426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:09.168749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ab3c7-351e-4073-88e2-71697c4a0a36 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:09.178443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 748/1495] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:11.147646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a1665-f487-43af-a4f2-94b5284774aa None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:11.147646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a1665-f487-43af-a4f2-94b5284774aa None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:11.147646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a1665-f487-43af-a4f2-94b5284774aa None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:11.149275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 748/1496] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:11.155036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435e64-809c-4378-b511-75a5568a262e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:11.155384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435e64-809c-4378-b511-75a5568a262e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:11.155717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435e64-809c-4378-b511-75a5568a262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:11.179338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-69435e64-809c-4378-b511-75a5568a262e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:11.180575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69435e64-809c-4378-b511-75a5568a262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:11.187859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 749/1497] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:11.329623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9f75e-dda8-4ef9-94ee-b11f488d1c16 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:11.329932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9f75e-dda8-4ef9-94ee-b11f488d1c16 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:11.330268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9f75e-dda8-4ef9-94ee-b11f488d1c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:11.353752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e2f9f75e-dda8-4ef9-94ee-b11f488d1c16 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:11.355008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2f9f75e-dda8-4ef9-94ee-b11f488d1c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:11.362848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 749/1498] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:11.374126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435e64-809c-4378-b511-75a5568a262e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:11.386729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435e64-809c-4378-b511-75a5568a262e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:11.391963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:11.392607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:11.392943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:11.393910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:11.402441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:11.430380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293d9f8-9a93-405b-abc1-80b7cc878911 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:11.440666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 750/1499] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:13.644947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf6cd-0080-455b-81df-9a935a2db57d None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:13.645482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf6cd-0080-455b-81df-9a935a2db57d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:13.645609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf6cd-0080-455b-81df-9a935a2db57d None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:13.647454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 750/1500] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:20:13.652907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:13.653265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:13.653605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:13.678429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:13.679645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:13.687094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 751/1501] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:13.827647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6708-fa1b-43fd-99ea-f67c43487d2a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:13.827991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6708-fa1b-43fd-99ea-f67c43487d2a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:13.828332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c6708-fa1b-43fd-99ea-f67c43487d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:13.851877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-317c6708-fa1b-43fd-99ea-f67c43487d2a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:13.853109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-317c6708-fa1b-43fd-99ea-f67c43487d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:13.860441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 751/1502] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:13.872442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:13.885227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae8d2c-5592-48f5-8cd6-4e8ddbfcf9e0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:13.890581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:13.891229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:13.891569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:13.891903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:13.900445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:13.929029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7258b1-0092-4e73-9980-f08bfc657ff5 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:13.938615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 752/1503] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:16.110995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026a3f-0060-4372-b738-87ca6e62b684 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:16.111573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026a3f-0060-4372-b738-87ca6e62b684 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:16.112288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0026a3f-0060-4372-b738-87ca6e62b684 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:16.114322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 752/1504] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:16.119925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:16.120276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:16.120614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:16.144692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:16.145947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:16.153250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 753/1505] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:16.294107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a7adf-9b9b-4163-af14-9b632eb97eef None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:16.294411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a7adf-9b9b-4163-af14-9b632eb97eef None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:16.294742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a7adf-9b9b-4163-af14-9b632eb97eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:16.318609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f3a7adf-9b9b-4163-af14-9b632eb97eef None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:16.319801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f3a7adf-9b9b-4163-af14-9b632eb97eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:16.327048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 753/1506] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:16.338463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:16.351515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0a948-a190-47e2-87f4-20d262fa9e7f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:16.356915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:16.357564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:16.357931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:16.358260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:16.367382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:16.395323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effa718-ee29-4d35-80e6-2f6df0dde9c6 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:16.405467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 754/1507] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:18.538239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad019-a560-4f24-9f61-e7d43d66c1d9 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:18.538794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad019-a560-4f24-9f61-e7d43d66c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:18.538925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ad019-a560-4f24-9f61-e7d43d66c1d9 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:18.540713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 754/1508] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:18.546486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:18.546840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:18.547176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:18.571772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:18.572977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:18.580450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 755/1509] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:18.719841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec536e-e765-4c55-b5c8-ab76edb295a7 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:18.720186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec536e-e765-4c55-b5c8-ab76edb295a7 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:18.720531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec536e-e765-4c55-b5c8-ab76edb295a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:18.745103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a8ec536e-e765-4c55-b5c8-ab76edb295a7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:18.746370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a8ec536e-e765-4c55-b5c8-ab76edb295a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:18.754398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 755/1510] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:18.765712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:18.778646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf189-c327-4d5f-a27f-fc50129aec55 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:18.783893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:18.784532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:18.784870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:18.785200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:18.793574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:18.821990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df5815-acf1-48bd-be8c-7b3c0e2cd77e service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:18.831908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 756/1511] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:20.976346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebaf3c-e91f-4666-a3b6-c5bcf631b52b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:20.976867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebaf3c-e91f-4666-a3b6-c5bcf631b52b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:20.977138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebaf3c-e91f-4666-a3b6-c5bcf631b52b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:20.979106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 756/1512] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:20.984736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:20.985085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:20.985420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:21.010154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:21.011361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:21.019322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 757/1513] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:21.163499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119458f2-204c-4c8b-8b5d-d22f79a90c9e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:21.163851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119458f2-204c-4c8b-8b5d-d22f79a90c9e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:21.164193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119458f2-204c-4c8b-8b5d-d22f79a90c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:21.187443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-119458f2-204c-4c8b-8b5d-d22f79a90c9e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:21.188649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-119458f2-204c-4c8b-8b5d-d22f79a90c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:21.196545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 757/1514] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:21.208616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:21.220690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b992c-3331-4e6f-95d2-13544db5e782 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:21.226148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:21.226844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:21.227134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:21.227467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:21.235835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:21.264841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd83948-3f3a-4bd8-82d5-afcc61a9f520 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:21.274341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 758/1515] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:31.045033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b857-d1b3-49c1-9083-cd79f757cccd None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.045454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b857-d1b3-49c1-9083-cd79f757cccd None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.045692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6b857-d1b3-49c1-9083-cd79f757cccd None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.047586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 758/1516] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:31.053835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d9d7-b335-48a3-b3c5-cbdd9f561ab7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.054217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d9d7-b335-48a3-b3c5-cbdd9f561ab7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.054552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857d9d7-b335-48a3-b3c5-cbdd9f561ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.079445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7857d9d7-b335-48a3-b3c5-cbdd9f561ab7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:31.080685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7857d9d7-b335-48a3-b3c5-cbdd9f561ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:31.088451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 759/1517] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:31.141292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da91c-b773-4998-bc30-e3291e570623 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.141642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da91c-b773-4998-bc30-e3291e570623 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.142009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da91c-b773-4998-bc30-e3291e570623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.165317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea2da91c-b773-4998-bc30-e3291e570623 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:31.166573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea2da91c-b773-4998-bc30-e3291e570623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:31.174735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 759/1518] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:31.225779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80d89-682a-4160-b3c8-d163a14e7b72 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.226301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80d89-682a-4160-b3c8-d163a14e7b72 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.226667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af80d89-682a-4160-b3c8-d163a14e7b72 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.228598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 760/1519] 10.222.0.18 () {54 vars in 950 bytes} [Sat Aug 21 12:20:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:31.233721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957101-a4ea-45d4-92d2-f58b0891b442 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.234068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957101-a4ea-45d4-92d2-f58b0891b442 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.234408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7957101-a4ea-45d4-92d2-f58b0891b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.307150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b7957101-a4ea-45d4-92d2-f58b0891b442 None None] MFA Rules not processed for user `8c3cbfabf9954b87b9a13bf68684d0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:31.308362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b7957101-a4ea-45d4-92d2-f58b0891b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:31.385320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 760/1520] 10.222.0.18 () {58 vars in 1048 bytes} [Sat Aug 21 12:20:31 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:31.394256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80d89-682a-4160-b3c8-d163a14e7b72 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:31.412583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af80d89-682a-4160-b3c8-d163a14e7b72 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:31.416329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:31.416988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:31.417337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:31.417663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:31.429357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:31.457704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e0ded-e247-4588-954a-47e19e64aa44 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:31.468092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 761/1521] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:20:34.608972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e88d2-0a4b-43a0-9201-b34f5837e9b0 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:34.609565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e88d2-0a4b-43a0-9201-b34f5837e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:34.609695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e88d2-0a4b-43a0-9201-b34f5837e9b0 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:34.612112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 761/1522] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:34.617701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:34.618074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:34.618409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:34.641652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:34.642886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:34.650188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 762/1523] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:34.673202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79337-9ad9-43b8-8d82-d75cf02dc52b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:34.673554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79337-9ad9-43b8-8d82-d75cf02dc52b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:34.674489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed79337-9ad9-43b8-8d82-d75cf02dc52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:34.697317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eed79337-9ad9-43b8-8d82-d75cf02dc52b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:34.698558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eed79337-9ad9-43b8-8d82-d75cf02dc52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:34.706642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 762/1524] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:34.712457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:34.722741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d23d-068b-4cec-8bae-f5a7b6f917f4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:34.727123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:34.727777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:34.728113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:34.728445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:34.729218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:34.757242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd41a8-9646-44d2-a1f2-50823189378f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:34.775603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 763/1525] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:20:34 2021] GET /identity/v3/projects => generated 2553 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:20:36.729016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348967f-9835-43f2-bcb8-a335459ad0b6 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.729632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348967f-9835-43f2-bcb8-a335459ad0b6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.729750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348967f-9835-43f2-bcb8-a335459ad0b6 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.731550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 763/1526] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:36.737920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.738301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.738672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.761688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:36.762939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:36.770213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 764/1527] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:36.792283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.792645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.792959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.816604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:36.817780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:36.825071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 764/1528] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:36.831248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:36.840821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdffb8b-356f-4bd5-affa-be6e3b3ed3f5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:36.845252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:36.846645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.846981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.847311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] PATH_INFO: `/v3/projects/1597b9d90cb1469eba0dcced76f27109` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.848502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] RBAC: Authorizing `identity:get_project(project_id=1597b9d90cb1469eba0dcced76f27109)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:36.877480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:36.879170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 765/1529] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:36 2021] GET /identity/v3/projects/1597b9d90cb1469eba0dcced76f27109 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:36.885327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:36.894858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc8f3e-ff1f-4a7f-88a2-7b5a4eece5b1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:36.899397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:36.900042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.900380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.900707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.901521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] RBAC: Adding query filter params (scope.project.id=1597b9d90cb1469eba0dcced76f27109) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:36.901895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:36.931713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:36.938754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 765/1530] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:36 2021] GET /identity/v3/role_assignments?scope.project.id=1597b9d90cb1469eba0dcced76f27109 => generated 1934 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:20:36.944723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:36.954600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713aaea-812d-4649-a375-d4f3563d215f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:36.959541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:36.960403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:36.960742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:36.961074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:36.962305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:36.990936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6dfd5-d12c-4fe3-b055-b4b01f0c46a6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:36.992552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 766/1531] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:36 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:36.998786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:37.008902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcefe5-2b26-4f85-83b0-7c6f0d2cc5ad admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:37.013475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:37.014394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:37.014733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:37.015064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:37.036209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:37.064827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ddfad-d78e-4dd5-bf20-e1455f758b32 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:37.066516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 766/1532] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:36 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:39.106792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458545-e077-4780-ac05-cfee3fd268f1 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.107347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458545-e077-4780-ac05-cfee3fd268f1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.107472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458545-e077-4780-ac05-cfee3fd268f1 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.109295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 767/1533] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:39.114855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.115201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.115543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.145776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:39.147051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:39.154567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 767/1534] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:39.176892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.177234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.177567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.201613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:39.202879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:39.210892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 768/1535] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:39.217232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:39.227046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543173c-e9ed-41a4-b527-90988a0487f6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:39.231694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:39.232627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.232962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.233292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] PATH_INFO: `/v3/projects/38ac9e7485b74786b44a99311be4b155` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.246444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=38ac9e7485b74786b44a99311be4b155)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:39.275468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:39.277090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 768/1536] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:39 2021] GET /identity/v3/projects/38ac9e7485b74786b44a99311be4b155 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:39.283497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:39.292678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5778bdd-f9f8-4607-8bef-98db472154fe None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:39.297380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:39.298055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.298941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.299834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.300304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] RBAC: Adding query filter params (scope.project.id=38ac9e7485b74786b44a99311be4b155) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:39.300656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:39.329330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae46dc-5829-4ca9-9e44-d471d0fa0d0f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:39.335078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 769/1537] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:39 2021] GET /identity/v3/role_assignments?scope.project.id=38ac9e7485b74786b44a99311be4b155 => generated 526 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:39.341054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:39.350850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b91560-146e-4b45-ad78-bc79bac04cc6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:39.355279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:39.356144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:39.356480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:39.356811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] PATH_INFO: `/v3/users/cc0c4aa333e344a2a96732367c6fb0b1` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:39.377346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc0c4aa333e344a2a96732367c6fb0b1)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:39.405442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c60bc-e7f8-4eba-8a32-ac1113cc53d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:39.407078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 769/1538] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:39 2021] GET /identity/v3/users/cc0c4aa333e344a2a96732367c6fb0b1 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:41.393324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac3fa-1d85-4b04-86b1-1d0fad984bef None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.393870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac3fa-1d85-4b04-86b1-1d0fad984bef None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.394032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ac3fa-1d85-4b04-86b1-1d0fad984bef None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.395866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 770/1539] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:41.401655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.402053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.402391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.426191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:41.427396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:41.434798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 770/1540] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:41.457607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.458003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.458340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.481482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:41.482726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:41.490557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 771/1541] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:41.496935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:41.507261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542e9ba-cb9d-49fd-a9b8-76e28b5eef84 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:41.511673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:41.512545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.512882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.513214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] PATH_INFO: `/v3/projects/452435bde81148b5b2befd5c252b2cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.525686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] RBAC: Authorizing `identity:get_project(project_id=452435bde81148b5b2befd5c252b2cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:41.554881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:41.556567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 771/1542] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:41 2021] GET /identity/v3/projects/452435bde81148b5b2befd5c252b2cec => generated 302 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:41.562915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:41.572725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a810-170f-4e4a-a37f-7cb2eeedf96e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:41.577110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:41.577750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.578133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.578465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.579276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] RBAC: Adding query filter params (scope.project.id=452435bde81148b5b2befd5c252b2cec) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:41.579625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:41.607417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:41.614900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 772/1543] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:41 2021] GET /identity/v3/role_assignments?scope.project.id=452435bde81148b5b2befd5c252b2cec => generated 1934 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:20:41.620693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:41.631020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d085455-12ca-424d-92a5-08d3369681fe admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:41.635473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:41.636337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.636675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.637008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] PATH_INFO: `/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.656635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b2a3a0c07804d7d84d3e31d65f4f6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:41.685592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6154-8d9d-43df-9f17-7f018a064484 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:41.687317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 772/1544] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:41 2021] GET /identity/v3/users/0b2a3a0c07804d7d84d3e31d65f4f6bb => generated 283 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:41.694585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:41.704501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212aef35-76a1-4bbc-b56e-14301a82dd5a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:41.708943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:41.709818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:41.710179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:41.710507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:41.711688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:41.739877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c0ea6-0ffa-4740-a029-9d44c6a3dd68 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:41.741434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 773/1545] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:41 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:43.788321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345f4c-759b-4c8f-b8ae-33b97b2adc1b None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:43.788884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345f4c-759b-4c8f-b8ae-33b97b2adc1b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:43.788979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73345f4c-759b-4c8f-b8ae-33b97b2adc1b None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:43.790880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 773/1546] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:43.796639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:43.796986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:43.797321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:43.820662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:43.821878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:43.829245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 774/1547] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:20:43.852262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:43.852777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:43.853146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:43.881933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:43.914105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:43.914105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 774/1548] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:43.914361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:43.914361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6f852-2c29-4381-896f-096ca874aabb None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:43.914361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:43.914361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:43.914760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:43.914760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] PATH_INFO: `/v3/projects/5e9fb8cd19474178a42340690072945c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:43.928190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] RBAC: Authorizing `identity:get_project(project_id=5e9fb8cd19474178a42340690072945c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:43.957947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:43.959676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 775/1549] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:43 2021] GET /identity/v3/projects/5e9fb8cd19474178a42340690072945c => generated 361 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:43.966228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:43.976589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a40d4d-f839-4a18-a474-14774892fa6c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:43.981168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:43.981920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:43.982313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:43.982674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:43.983579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] RBAC: Adding query filter params (scope.project.id=5e9fb8cd19474178a42340690072945c) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:43.983934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:44.012394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2307d1f-54b0-4e31-8518-c5d2913c0884 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:44.018975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 775/1550] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:43 2021] GET /identity/v3/role_assignments?scope.project.id=5e9fb8cd19474178a42340690072945c => generated 526 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:44.025367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:44.036155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ab5f9-fd70-42c7-b6bf-cdad996fc58a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:44.040590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:44.041418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:44.041750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:44.042106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] PATH_INFO: `/v3/users/2130723b305f4487bc6fd2d34f4e5eba` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:44.061983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] RBAC: Authorizing `identity:get_user(user_id=2130723b305f4487bc6fd2d34f4e5eba)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:44.091230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2e525-52ad-401e-9797-2ba257463790 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:44.092844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 776/1551] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:44 2021] GET /identity/v3/users/2130723b305f4487bc6fd2d34f4e5eba => generated 311 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:46.133318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d5c1-0dea-4d59-a4d1-4e7fd8f669c8 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.133983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d5c1-0dea-4d59-a4d1-4e7fd8f669c8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.133983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d5c1-0dea-4d59-a4d1-4e7fd8f669c8 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.135851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 776/1552] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:46.141346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.141703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.142090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.165623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:46.166897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:46.175067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 777/1553] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:46.197781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.198170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.198508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.223434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:46.224631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:46.231880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 777/1554] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:46.238521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:46.248042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777edd14-2ba0-4dfe-b20b-26b5d4b56971 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:46.253051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:46.253950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.254292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.254623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] PATH_INFO: `/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.255832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] RBAC: Authorizing `identity:get_project(project_id=8ce60da1aac441c9b29c109feb2ce1b7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:46.283895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:46.285577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 778/1555] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:46 2021] GET /identity/v3/projects/8ce60da1aac441c9b29c109feb2ce1b7 => generated 344 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:46.291471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:46.301738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e0501-c44a-4737-82fb-db5ac27817c1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:46.306223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:46.306885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.307225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.307557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.308374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] RBAC: Adding query filter params (scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:46.308727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:46.338049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1551ba-735a-4b52-aaf4-5dd0e6a7a430 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:46.344202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 778/1556] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:46 2021] GET /identity/v3/role_assignments?scope.project.id=8ce60da1aac441c9b29c109feb2ce1b7 => generated 879 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:46.350391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:46.360336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1841c7-6c25-4964-90f8-9c243c305877 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:46.365331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:46.366221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:46.366559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:46.366894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] PATH_INFO: `/v3/users/2ba5d31461a040c292e70a0ffe9aec5b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:46.368084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba5d31461a040c292e70a0ffe9aec5b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:46.396276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ada6fc-a557-42bd-8d73-83249b14cb82 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:46.397911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 779/1557] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:46 2021] GET /identity/v3/users/2ba5d31461a040c292e70a0ffe9aec5b => generated 247 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:48.409400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c4c5-7df3-4be2-8c62-cef3377c89a3 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.409946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c4c5-7df3-4be2-8c62-cef3377c89a3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.410118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9c4c5-7df3-4be2-8c62-cef3377c89a3 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.412576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 779/1558] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:48.418406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.418823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.419196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.442718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:48.443900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:48.451287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 780/1559] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:48.474268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.474614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.474951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.498840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:48.500092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:48.507708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 780/1560] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:48.513995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:48.524370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16253-d8ef-414c-9225-ceb8fcb8a33e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:48.528839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:48.529706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.530093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.530422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] PATH_INFO: `/v3/projects/c032907e45dc46938de3fa8fed758dc6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.543682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] RBAC: Authorizing `identity:get_project(project_id=c032907e45dc46938de3fa8fed758dc6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:48.572442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:48.574235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 781/1561] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:48 2021] GET /identity/v3/projects/c032907e45dc46938de3fa8fed758dc6 => generated 311 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:48.580307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:48.590039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28c5a6-ab62-425c-9af0-bc7506432578 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:48.594439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:48.595088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.595422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.595751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.596558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] RBAC: Adding query filter params (scope.project.id=c032907e45dc46938de3fa8fed758dc6) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:48.596908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:48.624886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:48.631414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 781/1562] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:48 2021] GET /identity/v3/role_assignments?scope.project.id=c032907e45dc46938de3fa8fed758dc6 => generated 877 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:48.637274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:48.647790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92b5f5-9de2-4342-ad69-fe7d641fe4bd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:48.652388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:48.653278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.653620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.653992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] PATH_INFO: `/v3/users/f202aaa2cab048cfa57da108c583ae4c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.674228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] RBAC: Authorizing `identity:get_user(user_id=f202aaa2cab048cfa57da108c583ae4c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:48.704205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d54d-0470-4c94-b059-1bdaaca40147 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:48.705841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 782/1563] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:48 2021] GET /identity/v3/users/f202aaa2cab048cfa57da108c583ae4c => generated 286 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:48.712462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:48.722498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907ae32-2330-433f-9fa0-c8ebd41308ef admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:48.726912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:48.727786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:48.728129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:48.728461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] PATH_INFO: `/v3/users/ee5eb2e8d92648ca82141f3bd3718c50` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:48.747931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] RBAC: Authorizing `identity:get_user(user_id=ee5eb2e8d92648ca82141f3bd3718c50)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:48.777199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fdb30-5b1b-4183-87a4-718cef5f001d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:48.778836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 782/1564] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:48 2021] GET /identity/v3/users/ee5eb2e8d92648ca82141f3bd3718c50 => generated 285 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:50.829609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75d7be-342c-430b-ad7d-dd7423387ebe None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:50.830202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75d7be-342c-430b-ad7d-dd7423387ebe None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:50.830318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75d7be-342c-430b-ad7d-dd7423387ebe None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:50.832684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 783/1565] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:50.838300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:50.838642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:50.838973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:50.862304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:50.863534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:50.870790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 783/1566] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:50.893370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:50.893762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:50.894777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:50.918529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:50.919753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:50.927153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 784/1567] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:50.933163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:50.943493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f84d44-52bc-48ef-a89c-221ead7b1281 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:50.947920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:50.948793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:50.949129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:50.949462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] PATH_INFO: `/v3/projects/f47a6963c1a74b259f6bdb1763812584` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:50.962773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] RBAC: Authorizing `identity:get_project(project_id=f47a6963c1a74b259f6bdb1763812584)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:50.991327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:50.993112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 784/1568] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Aug 21 12:20:50 2021] GET /identity/v3/projects/f47a6963c1a74b259f6bdb1763812584 => generated 312 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:20:50.999683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:51.009585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7d89-ae93-4971-a776-ddb65c15a671 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:51.014269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:51.014922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:51.015259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:51.015592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:51.016412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] RBAC: Adding query filter params (scope.project.id=f47a6963c1a74b259f6bdb1763812584) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:20:51.016764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:51.045651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6035c-2e9e-4b6f-965d-4f6cb3be325d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:51.051709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 785/1569] 10.222.0.18 () {56 vars in 1222 bytes} [Sat Aug 21 12:20:50 2021] GET /identity/v3/role_assignments?scope.project.id=f47a6963c1a74b259f6bdb1763812584 => generated 526 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:20:51.058062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:51.068747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a085ee6-e60c-4520-ba93-fa78c9382b55 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:51.073188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:51.074146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:51.074480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:51.074807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] PATH_INFO: `/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:51.076005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] RBAC: Authorizing `identity:get_user(user_id=d9c872fcf7bd4f71b8f819a9ced93c00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:51.105127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97565fa-4394-4251-a7f3-ac2444478aad admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:51.106718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 785/1570] 10.222.0.18 () {56 vars in 1189 bytes} [Sat Aug 21 12:20:51 2021] GET /identity/v3/users/d9c872fcf7bd4f71b8f819a9ced93c00 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:20:55.936564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199201b-1402-49f1-bfa4-74052a609f69 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:55.937127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199201b-1402-49f1-bfa4-74052a609f69 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:55.937250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199201b-1402-49f1-bfa4-74052a609f69 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:55.939105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 786/1571] 10.222.0.18 () {54 vars in 907 bytes} [Sat Aug 21 12:20:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:55.945175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd14-31bf-4056-9a1f-b85039aa90a3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:55.945526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd14-31bf-4056-9a1f-b85039aa90a3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:55.945914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03dd14-31bf-4056-9a1f-b85039aa90a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:55.969829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ec03dd14-31bf-4056-9a1f-b85039aa90a3 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:55.971057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ec03dd14-31bf-4056-9a1f-b85039aa90a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:55.982118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 786/1572] 10.222.0.18 () {58 vars in 1005 bytes} [Sat Aug 21 12:20:55 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:56.040010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8201-458a-490a-ae28-6fa787ad0296 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:56.040359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8201-458a-490a-ae28-6fa787ad0296 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:56.040693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be8201-458a-490a-ae28-6fa787ad0296 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:56.042571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 787/1573] 10.222.0.18 () {54 vars in 907 bytes} [Sat Aug 21 12:20:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:56.048235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8acb-124e-486c-8108-2449ec15483f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:56.048586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8acb-124e-486c-8108-2449ec15483f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:56.048921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8acb-124e-486c-8108-2449ec15483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:56.072958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a3b8acb-124e-486c-8108-2449ec15483f None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:56.074205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a3b8acb-124e-486c-8108-2449ec15483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:56.082740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 787/1574] 10.222.0.18 () {58 vars in 1005 bytes} [Sat Aug 21 12:20:56 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:58.466886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9435d5-27f6-4a51-a8ed-539fcfefe29e None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:58.467438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9435d5-27f6-4a51-a8ed-539fcfefe29e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:58.467568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9435d5-27f6-4a51-a8ed-539fcfefe29e None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:58.469361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 788/1575] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:20:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:20:58.475418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:58.475774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:58.476115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:58.500148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:58.501595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:58.509076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 788/1576] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:58.650227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f63-78d3-4bf4-8696-0876c427bde4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:58.650577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f63-78d3-4bf4-8696-0876c427bde4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:58.650922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1f63-78d3-4bf4-8696-0876c427bde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:58.677361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6cac1f63-78d3-4bf4-8696-0876c427bde4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:20:58.678628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cac1f63-78d3-4bf4-8696-0876c427bde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:20:58.686074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 789/1577] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:20:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:20:58.697979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:20:58.710862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ef697-7110-4cdc-8376-ab51312bf58d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:20:58.715946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:20:58.716595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:20:58.716977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:20:58.717263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:20:58.726381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:20:58.754336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2e056-55e9-4b32-8e9d-d36dff9c39e3 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:20:58.763836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 789/1578] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:20:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:00.345687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716633-6c00-4acb-8151-c96bb06b5442 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:00.346294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716633-6c00-4acb-8151-c96bb06b5442 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:00.346414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33716633-6c00-4acb-8151-c96bb06b5442 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:00.348825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 790/1579] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:00.354006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451310f-e8c9-468d-bcac-8dc68d042fc3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:00.354349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451310f-e8c9-468d-bcac-8dc68d042fc3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:00.354683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451310f-e8c9-468d-bcac-8dc68d042fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:00.378268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e451310f-e8c9-468d-bcac-8dc68d042fc3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:00.379478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e451310f-e8c9-468d-bcac-8dc68d042fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:00.386775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 790/1580] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:00.525271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33716633-6c00-4acb-8151-c96bb06b5442 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:00.540251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33716633-6c00-4acb-8151-c96bb06b5442 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:00.545696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:00.546395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:00.546735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:00.547115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:00.555615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:00.584404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158c19-fba6-4545-9192-fcd462ecafb7 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:00.593897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 791/1581] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:02.234090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c992-3e93-424a-a3c0-d91b0fb439dd None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:02.234646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c992-3e93-424a-a3c0-d91b0fb439dd None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:02.234773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c992-3e93-424a-a3c0-d91b0fb439dd None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:02.236598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 791/1582] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:02.242559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102af4-4356-4e16-ad86-ec66e265a2b1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:02.242905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102af4-4356-4e16-ad86-ec66e265a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:02.243240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6102af4-4356-4e16-ad86-ec66e265a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:02.266766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b6102af4-4356-4e16-ad86-ec66e265a2b1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:02.267910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b6102af4-4356-4e16-ad86-ec66e265a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:02.275573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 792/1583] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:02.414146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458c992-3e93-424a-a3c0-d91b0fb439dd None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:02.429549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458c992-3e93-424a-a3c0-d91b0fb439dd None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:02.434861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:02.435510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:02.435854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:02.436186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:02.444646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:02.473757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baf70f-3bde-4117-b679-9f91104a1538 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:02.483349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 792/1584] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:04.117827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827383-dd48-4428-afa4-8e4cc5e319ab None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:04.118743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827383-dd48-4428-afa4-8e4cc5e319ab None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:04.119084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827383-dd48-4428-afa4-8e4cc5e319ab None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:04.121012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 793/1585] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:04.126283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae21f6-0b71-4f86-8fb0-35f4252d795c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:04.126638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae21f6-0b71-4f86-8fb0-35f4252d795c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:04.126974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae21f6-0b71-4f86-8fb0-35f4252d795c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:04.151113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bfae21f6-0b71-4f86-8fb0-35f4252d795c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:04.152332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bfae21f6-0b71-4f86-8fb0-35f4252d795c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:04.159923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 793/1586] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:04.298620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827383-dd48-4428-afa4-8e4cc5e319ab None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:04.313352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827383-dd48-4428-afa4-8e4cc5e319ab None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:04.318674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:04.319322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:04.319664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:04.319998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:04.328502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:04.356953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99c0c9-1d29-4f9e-906d-7edf9c437270 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:04.367052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 794/1587] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:06.004577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f71cbc-ed93-444a-aa7b-cda10e643bcb None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:06.005145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f71cbc-ed93-444a-aa7b-cda10e643bcb None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:06.005266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f71cbc-ed93-444a-aa7b-cda10e643bcb None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:06.007243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 794/1588] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:06.012800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9d4f-825a-4bcc-8bcc-8973fde041af None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:06.013026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9d4f-825a-4bcc-8bcc-8973fde041af None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:06.013363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d9d4f-825a-4bcc-8bcc-8973fde041af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:06.037570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-162d9d4f-825a-4bcc-8bcc-8973fde041af None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:06.038841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-162d9d4f-825a-4bcc-8bcc-8973fde041af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:06.046443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 795/1589] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:06.183171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f71cbc-ed93-444a-aa7b-cda10e643bcb None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:06.197427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f71cbc-ed93-444a-aa7b-cda10e643bcb None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:06.202685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:06.203330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:06.203666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:06.203993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:06.212841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:06.241269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab532b2-2eca-451c-b689-9886b2c997e4 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:06.250639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 795/1590] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:07.842498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1e7b-7f27-4e9d-8825-a11b6ae5d3a4 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:07.843061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1e7b-7f27-4e9d-8825-a11b6ae5d3a4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:07.843182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b1e7b-7f27-4e9d-8825-a11b6ae5d3a4 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:07.844974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 796/1591] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:07.850774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf3d0-ee3a-4eb3-82d8-7ffbd897f818 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:07.851122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf3d0-ee3a-4eb3-82d8-7ffbd897f818 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:07.851460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eaf3d0-ee3a-4eb3-82d8-7ffbd897f818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:07.875407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c5eaf3d0-ee3a-4eb3-82d8-7ffbd897f818 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:07.878653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c5eaf3d0-ee3a-4eb3-82d8-7ffbd897f818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:07.884486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 796/1592] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:08.022322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b1e7b-7f27-4e9d-8825-a11b6ae5d3a4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:08.037006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b1e7b-7f27-4e9d-8825-a11b6ae5d3a4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:08.042257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:08.043147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:08.043481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:08.043810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:08.052221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:08.080246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0d1a-18b3-477f-8786-bee294e07349 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:08.090214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 797/1593] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:09.650768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a897-2010-4bed-8acc-05416a5416a6 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:09.651367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a897-2010-4bed-8acc-05416a5416a6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:09.651490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8a897-2010-4bed-8acc-05416a5416a6 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:09.653280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 797/1594] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:09.658643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d93-018f-4e4a-a4d2-ef11270ed2ed None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:09.658996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d93-018f-4e4a-a4d2-ef11270ed2ed None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:09.659331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d93-018f-4e4a-a4d2-ef11270ed2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:09.683315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c2bc8d93-018f-4e4a-a4d2-ef11270ed2ed None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:09.684524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c2bc8d93-018f-4e4a-a4d2-ef11270ed2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:09.692473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 798/1595] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:09.830529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8a897-2010-4bed-8acc-05416a5416a6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:09.845461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8a897-2010-4bed-8acc-05416a5416a6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:09.850974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:09.851619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:09.851954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:09.852282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:09.860795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:09.889033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867731f-0770-47a5-a5af-582eb3f7b343 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:09.899255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 798/1596] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:11.478875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd158-4f51-41fb-a293-880126f6e04e None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:11.479446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd158-4f51-41fb-a293-880126f6e04e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:11.479566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbd158-4f51-41fb-a293-880126f6e04e None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:11.481407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 799/1597] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:11.486518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1297-68e4-4a0d-8dd0-55f946e346f8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:11.486867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1297-68e4-4a0d-8dd0-55f946e346f8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:11.487705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e1297-68e4-4a0d-8dd0-55f946e346f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:11.512445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-663e1297-68e4-4a0d-8dd0-55f946e346f8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:11.513651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-663e1297-68e4-4a0d-8dd0-55f946e346f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:11.521012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 799/1598] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:11.659155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbd158-4f51-41fb-a293-880126f6e04e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:11.673658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbd158-4f51-41fb-a293-880126f6e04e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:11.679441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:11.680092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:11.680433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:11.680765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:11.689205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:11.717537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cb42-e207-4e75-9013-a24f8e0873f6 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:11.727014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 800/1599] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:13.304061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50aa3-40f4-4765-8607-5ddfb4de989f None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:13.304587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50aa3-40f4-4765-8607-5ddfb4de989f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:13.304711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a50aa3-40f4-4765-8607-5ddfb4de989f None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:13.306521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 800/1600] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:13.311760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ef40-d2ef-4d5b-bc20-abf3e24297e1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:13.312130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ef40-d2ef-4d5b-bc20-abf3e24297e1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:13.312505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4ef40-d2ef-4d5b-bc20-abf3e24297e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:13.336970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-dfe4ef40-d2ef-4d5b-bc20-abf3e24297e1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:13.338213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dfe4ef40-d2ef-4d5b-bc20-abf3e24297e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:13.345546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 801/1601] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:13.482049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a50aa3-40f4-4765-8607-5ddfb4de989f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:13.497099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a50aa3-40f4-4765-8607-5ddfb4de989f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:13.502357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:13.503662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:13.504305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:13.504641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:13.517235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:13.546000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b2cc9-0b3f-4b60-a3ba-936f412766af service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:13.555603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 801/1602] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:15.531407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765d56-52ae-4abc-aca3-8272e98ef026 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:15.532372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765d56-52ae-4abc-aca3-8272e98ef026 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:15.532743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765d56-52ae-4abc-aca3-8272e98ef026 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:15.535325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 802/1603] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:15.541104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:15.541456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:15.541839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:15.567366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:15.568567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:15.575866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 802/1604] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:15.603110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126235da-c457-49ba-8f9e-6fb02522de5d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:15.603461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126235da-c457-49ba-8f9e-6fb02522de5d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:15.603797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126235da-c457-49ba-8f9e-6fb02522de5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:15.626581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-126235da-c457-49ba-8f9e-6fb02522de5d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:15.628290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-126235da-c457-49ba-8f9e-6fb02522de5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:15.635669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 803/1605] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:15.656703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:15.666635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b826ece-588b-48d5-adc1-d1da8ea8dd13 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:15.670494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:15.671142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:15.671485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:15.671819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:15.681174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:15.710385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3352f5-d66b-466d-aadc-1383e05b93d0 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:15.720546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 803/1606] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:21:17.856604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf84e1-9bac-4593-9e43-78b08ffb53b2 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:17.857164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf84e1-9bac-4593-9e43-78b08ffb53b2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:17.857267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf84e1-9bac-4593-9e43-78b08ffb53b2 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:17.859135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 804/1607] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:17.865339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:17.869891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:17.869891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:17.889565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:17.890802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:17.898333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 804/1608] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:17.924437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55317e-b6a8-478f-b809-dec9f28d4546 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:17.925278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55317e-b6a8-478f-b809-dec9f28d4546 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:17.925614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55317e-b6a8-478f-b809-dec9f28d4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:17.948558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2d55317e-b6a8-478f-b809-dec9f28d4546 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:17.949747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2d55317e-b6a8-478f-b809-dec9f28d4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:17.957174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 805/1609] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:17.978070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:17.988623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbb1cc-0104-4da7-bd09-83e6d8f51c44 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:17.992162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:17.992810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:17.993149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:17.993482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:18.002946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:18.031371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31951077-ce1a-451b-8e7a-6dc259222794 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:18.041819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 805/1610] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:20.553758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43ced-3908-46cb-8237-5821c51b5dd9 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:20.554335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43ced-3908-46cb-8237-5821c51b5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:20.554462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43ced-3908-46cb-8237-5821c51b5dd9 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:20.556271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 806/1611] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:20.562069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:20.562430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:20.562767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:20.587074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:20.588327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:20.595666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 806/1612] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:20.622942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcc32-47e3-4175-ae87-d0f90594a890 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:20.623292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcc32-47e3-4175-ae87-d0f90594a890 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:20.623632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bcc32-47e3-4175-ae87-d0f90594a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:20.647167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f99bcc32-47e3-4175-ae87-d0f90594a890 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:20.648370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f99bcc32-47e3-4175-ae87-d0f90594a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:20.655735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 807/1613] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:20.676078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:20.685713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb8cf4-b6ce-499d-80a5-c4aab68252ab None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:20.689266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:20.690569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:20.690904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:20.691234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:20.700465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:20.728135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222eeb3c-d125-4654-95ad-18e3b5b79dcc service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:20.738078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 807/1614] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:22.850818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97122c-307d-4716-85af-4d13c86e99e3 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:22.851378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97122c-307d-4716-85af-4d13c86e99e3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:22.851502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97122c-307d-4716-85af-4d13c86e99e3 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:22.853302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 808/1615] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:22.859169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:22.859516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:22.859850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:22.884599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:22.885867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:22.893173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 808/1616] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:22.920143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638c0d-6c86-4dfc-bab1-cffa039b8a0b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:22.920485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638c0d-6c86-4dfc-bab1-cffa039b8a0b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:22.920820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b638c0d-6c86-4dfc-bab1-cffa039b8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:22.945120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6b638c0d-6c86-4dfc-bab1-cffa039b8a0b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:22.946330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6b638c0d-6c86-4dfc-bab1-cffa039b8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:22.954192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 809/1617] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:22.974003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:22.983734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2847a-518f-48d7-b324-f7ffdf90631e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:22.987837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:22.988477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:22.988808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:22.989137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:22.998425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:23.026827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a291cd-9b18-4f73-8d00-01458d92be5e service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:23.037053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 809/1618] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:25.132324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c69bd-c405-4428-b86c-c66433ef8e0f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:25.132844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c69bd-c405-4428-b86c-c66433ef8e0f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:25.133010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c69bd-c405-4428-b86c-c66433ef8e0f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:25.134958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 810/1619] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:25.144710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:25.145283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:25.145819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:25.170096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:25.171313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:25.179271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 810/1620] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:25.206844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d4a4-ce5b-4d57-9f74-53221b8be7b7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:25.207193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d4a4-ce5b-4d57-9f74-53221b8be7b7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:25.207533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d4a4-ce5b-4d57-9f74-53221b8be7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:25.230542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ec55d4a4-ce5b-4d57-9f74-53221b8be7b7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:25.231744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ec55d4a4-ce5b-4d57-9f74-53221b8be7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:25.239676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 811/1621] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:25.259874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:25.269652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28453e23-73ac-4873-875d-af3a3e75510d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:25.273100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:25.273746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:25.274109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:25.274439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:25.284093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:25.312783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0df0b0-07f6-4565-beda-cc036eacf406 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:25.322267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 811/1622] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:27.443732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b3bb-1263-4f70-a781-bd0a82cf085b None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:27.444273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b3bb-1263-4f70-a781-bd0a82cf085b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:27.444386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91b3bb-1263-4f70-a781-bd0a82cf085b None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:27.446275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 812/1623] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:27.452144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:27.452494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:27.452830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:27.476349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:27.477557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:27.484922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 812/1624] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:27.513669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75390-46f3-49e6-b17f-2b2240b99720 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:27.514045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75390-46f3-49e6-b17f-2b2240b99720 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:27.514388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a75390-46f3-49e6-b17f-2b2240b99720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:27.537731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-50a75390-46f3-49e6-b17f-2b2240b99720 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:27.538958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-50a75390-46f3-49e6-b17f-2b2240b99720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:27.546789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 813/1625] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:27.566998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:27.577043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d04f3b-5c56-4d1b-8be4-4c74b303b054 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:27.580600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:27.581253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:27.581594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:27.581965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:27.591220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:27.619909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281d4fc-8921-4562-8418-6c53028fd3d5 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:27.629377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 813/1626] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:21:29.863546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff0b5-e183-4fce-9ee5-415092369b43 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:29.864050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff0b5-e183-4fce-9ee5-415092369b43 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:29.864207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ff0b5-e183-4fce-9ee5-415092369b43 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:29.866105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 814/1627] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:29.872214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:29.872565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:29.872902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:29.896989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:29.898256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:29.909252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 814/1628] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:29.940512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fade-c8ba-42e1-8873-a9934df6aa8f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:29.940859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fade-c8ba-42e1-8873-a9934df6aa8f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:29.941201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3fade-c8ba-42e1-8873-a9934df6aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:29.964264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c0d3fade-c8ba-42e1-8873-a9934df6aa8f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:29.965492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0d3fade-c8ba-42e1-8873-a9934df6aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:29.973920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 815/1629] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:29.993280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:30.003136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f4ddb-40e9-4c9f-9c1e-6e5e63bc1188 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:30.006742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:30.007467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:30.007871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:30.008273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:30.017881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:30.046609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9390-4fe2-4269-984a-46b12b6a886c service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:30.056972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 815/1630] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:32.107097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b70d5-2762-4b9e-9357-0e9b0774a5c1 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:32.107607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b70d5-2762-4b9e-9357-0e9b0774a5c1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:32.107749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b70d5-2762-4b9e-9357-0e9b0774a5c1 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:32.109591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 816/1631] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:32.115953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:32.116300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:32.116639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:32.140085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:32.141286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:32.148669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 816/1632] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:32.179819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46622-a409-4e22-beb1-e28aa6e13308 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:32.180166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46622-a409-4e22-beb1-e28aa6e13308 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:32.180501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46622-a409-4e22-beb1-e28aa6e13308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:32.204767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-47a46622-a409-4e22-beb1-e28aa6e13308 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:32.205988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-47a46622-a409-4e22-beb1-e28aa6e13308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:32.213175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 817/1633] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:32.232191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:32.242661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf81684-76a4-40ea-99cf-1178f3446032 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:32.246123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:32.246766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:32.247121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:32.247429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:32.256694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:32.284743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c968b-2fe9-48cc-9bd4-0cb5e39a4ee8 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:32.294366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 817/1634] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:34.343687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908923f-e18a-4608-bc71-4832eb5503f8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:34.344213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908923f-e18a-4608-bc71-4832eb5503f8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:34.344327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908923f-e18a-4608-bc71-4832eb5503f8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:34.346150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 818/1635] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:34.351822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:34.352171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:34.352510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:34.376007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:34.377979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:34.385275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 818/1636] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:34.414446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419e7f-ec09-449f-b91c-d41aeee17f2a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:34.414789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419e7f-ec09-449f-b91c-d41aeee17f2a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:34.415155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419e7f-ec09-449f-b91c-d41aeee17f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:34.438161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-10419e7f-ec09-449f-b91c-d41aeee17f2a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:34.439857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-10419e7f-ec09-449f-b91c-d41aeee17f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:34.447255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 819/1637] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:34.467345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:34.477065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1825d-6396-4842-a689-1ea3177ea592 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:34.480787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:34.481438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:34.481777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:34.482153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:34.491879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:34.521155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1beb6-9db1-4eaa-b49a-95d197fb98dc service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:34.530681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 819/1638] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:36.570880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d1d6-2f07-4848-a068-ed2ba0114156 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:36.571486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d1d6-2f07-4848-a068-ed2ba0114156 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:36.571610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06d1d6-2f07-4848-a068-ed2ba0114156 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:36.573430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 820/1639] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:36.579071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:36.579418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:36.579751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:36.603870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:36.605059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:36.612978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 820/1640] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:36.640677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496efb-3c03-48b6-9bbb-fb8522cf8f80 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:36.641026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496efb-3c03-48b6-9bbb-fb8522cf8f80 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:36.641360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c496efb-3c03-48b6-9bbb-fb8522cf8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:36.664682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9c496efb-3c03-48b6-9bbb-fb8522cf8f80 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:36.665907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9c496efb-3c03-48b6-9bbb-fb8522cf8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:36.673552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 821/1641] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:36.693653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:36.703355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f048e-3dc1-4bff-9999-ea322eb857b3 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:36.706867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:36.707507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:36.707841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:36.708167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:36.717517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:36.746289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270820c-9a91-402d-a387-19f2141a0813 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:36.755704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 821/1642] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:49.900815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dd89c-c72e-4c53-ac9d-d1b9c54829eb None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:49.901382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dd89c-c72e-4c53-ac9d-d1b9c54829eb None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:49.901550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58dd89c-c72e-4c53-ac9d-d1b9c54829eb None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:49.903400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 822/1643] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:49.910269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:49.910618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:49.910955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:49.937424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:49.938678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:49.946461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 822/1644] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:49.972581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e0ae-0da5-448a-aa06-f1a859c76489 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:49.972930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e0ae-0da5-448a-aa06-f1a859c76489 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:49.973270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e0ae-0da5-448a-aa06-f1a859c76489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:49.996741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5c61e0ae-0da5-448a-aa06-f1a859c76489 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:49.998013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5c61e0ae-0da5-448a-aa06-f1a859c76489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:50.005838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 823/1645] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:50.034600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:50.036024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:50.133529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005bdd6-28a9-4476-9837-babccd6328b5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:50.137180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:50.137851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:50.138196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:50.138529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:50.148398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:50.176308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f45fd5-558b-481c-abdd-ea4fe54415d0 service glance] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:50.185733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 823/1646] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:52.239382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aab4e-b475-46c1-97b9-7798cbddef61 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:52.239916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aab4e-b475-46c1-97b9-7798cbddef61 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:52.240037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423aab4e-b475-46c1-97b9-7798cbddef61 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:52.241935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 824/1647] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:52.247503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:52.247849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:52.248224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:52.272888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:52.274084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:52.281633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 824/1648] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:52.304134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604dfd-fe94-410e-9ce8-d9cad2773545 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:52.304513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604dfd-fe94-410e-9ce8-d9cad2773545 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:52.304890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604dfd-fe94-410e-9ce8-d9cad2773545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:52.328526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ef604dfd-fe94-410e-9ce8-d9cad2773545 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:52.330376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ef604dfd-fe94-410e-9ce8-d9cad2773545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:52.337745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 825/1649] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:52.343859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:52.353558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597d8f-36b4-42f3-8036-a0aab09f36ec None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:52.358078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:52.358729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:52.359061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:52.359387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:52.360157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:52.388753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30372892-e508-4c53-9bad-febd36ec70b4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:52.405513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 825/1650] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Aug 21 12:21:52 2021] GET /identity/v3/projects => generated 2553 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:21:53.983213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ecaa-e2b3-4af3-adf5-0f4071c5a134 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:53.983717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ecaa-e2b3-4af3-adf5-0f4071c5a134 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:53.983874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957ecaa-e2b3-4af3-adf5-0f4071c5a134 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:53.985732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 826/1651] 10.222.0.18 () {54 vars in 900 bytes} [Sat Aug 21 12:21:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:53.991675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f109-5c6e-4b97-b521-2d26c763bd21 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:53.992048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f109-5c6e-4b97-b521-2d26c763bd21 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:53.992384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0f109-5c6e-4b97-b521-2d26c763bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:54.015403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-abe0f109-5c6e-4b97-b521-2d26c763bd21 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:54.016609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-abe0f109-5c6e-4b97-b521-2d26c763bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:54.024091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 826/1652] 10.222.0.18 () {58 vars in 998 bytes} [Sat Aug 21 12:21:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:54.162104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ecaa-e2b3-4af3-adf5-0f4071c5a134 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:54.177189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957ecaa-e2b3-4af3-adf5-0f4071c5a134 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:54.182579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:54.183226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:54.183566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:54.183902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:54.192965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:54.220676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e477d-3e09-451d-8ac2-bf8d26d6c0b4 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:54.230202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 827/1653] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:56.269710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202917-6140-458b-83fd-4d2cc0481d37 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:56.270289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202917-6140-458b-83fd-4d2cc0481d37 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:56.270415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d202917-6140-458b-83fd-4d2cc0481d37 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:56.272163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 827/1654] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:56.277981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:56.278337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:56.278675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:56.303438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:56.304648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:56.312096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 828/1655] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:56.336739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a8f5-bdba-42e2-87f3-ef62a2945cd4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:56.337087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a8f5-bdba-42e2-87f3-ef62a2945cd4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:56.337419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5a8f5-bdba-42e2-87f3-ef62a2945cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:56.360839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b3a5a8f5-bdba-42e2-87f3-ef62a2945cd4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:56.362686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b3a5a8f5-bdba-42e2-87f3-ef62a2945cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:56.369936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 828/1656] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:56.388414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:56.398697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44540f81-52ce-4fa0-9e6b-4863ecc06653 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:56.402259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:56.402905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:56.403245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:56.403583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:56.412990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:56.441913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471afb2a-10d6-472e-929a-8478e80aff3e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:56.451348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 829/1657] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:21:58.496982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8390ec-09fb-4e39-9e76-1f354479be64 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:58.498024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8390ec-09fb-4e39-9e76-1f354479be64 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:58.498578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8390ec-09fb-4e39-9e76-1f354479be64 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:58.500660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 829/1658] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:21:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:21:58.507215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:58.507568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:58.507905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:58.532214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:58.533475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:58.540987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 830/1659] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:58.569087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865320-6702-46fb-a5b3-2873faf74721 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:58.569436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865320-6702-46fb-a5b3-2873faf74721 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:58.569771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1865320-6702-46fb-a5b3-2873faf74721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:58.593473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f1865320-6702-46fb-a5b3-2873faf74721 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:21:58.594689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f1865320-6702-46fb-a5b3-2873faf74721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:21:58.602076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 830/1660] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:21:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:21:58.621714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:21:58.632021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aed311-ed2c-41a1-948e-103e3e4f2db6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:21:58.635636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:21:58.636285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:21:58.636624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:21:58.636959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:21:58.646940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:21:58.675238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eaf98d-9219-47cb-bcc6-086b721f189e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:21:58.685067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 831/1661] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:21:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:22:00.821253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b970-c848-458b-8fac-ce5018d5f436 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:00.821857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b970-c848-458b-8fac-ce5018d5f436 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:00.822014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4b970-c848-458b-8fac-ce5018d5f436 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:00.823788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 831/1662] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:22:00.829712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:00.830683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:00.831018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:00.854679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:22:00.855901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:22:00.863404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 832/1663] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:22:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:22:00.891591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be925c7-c223-4056-8c5a-6455fbff12e1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:00.891939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be925c7-c223-4056-8c5a-6455fbff12e1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:00.892274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be925c7-c223-4056-8c5a-6455fbff12e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:00.915863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5be925c7-c223-4056-8c5a-6455fbff12e1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:22:00.917369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5be925c7-c223-4056-8c5a-6455fbff12e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:22:00.925197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 832/1664] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:22:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:22:00.945455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:22:00.955430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbca32-6913-4b2b-83b4-80385cbc8b93 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:22:00.959125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:22:00.959784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:00.960129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:00.960455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:00.969932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:22:00.998305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf27c34-d9fe-4254-957b-e8865663d905 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:22:01.010534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 833/1665] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:22:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:22:03.626413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72f82-de61-42a8-9aeb-a4a0168873ee None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:03.626989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72f82-de61-42a8-9aeb-a4a0168873ee None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:03.627084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f72f82-de61-42a8-9aeb-a4a0168873ee None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:03.628925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 833/1666] 10.222.0.18 () {54 vars in 915 bytes} [Sat Aug 21 12:22:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:22:03.634700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:03.635048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:03.635403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:03.659308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:22:03.660501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:22:03.668156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 834/1667] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:22:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:22:03.702458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddef4-53cf-4122-9adc-159921885be1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:03.702803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddef4-53cf-4122-9adc-159921885be1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:03.703135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ddef4-53cf-4122-9adc-159921885be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:03.726551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b38ddef4-53cf-4122-9adc-159921885be1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:22:03.727744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b38ddef4-53cf-4122-9adc-159921885be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:22:03.735028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 834/1668] 10.222.0.18 () {58 vars in 1013 bytes} [Sat Aug 21 12:22:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:22:03.755089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:22:03.764787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b955066-9d30-4458-9064-f17a360fbcca None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:22:03.768365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:22:03.769012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:22:03.769349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:22:03.769680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:22:03.778961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:22:03.809000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232343-0e3f-40a5-92f6-d022cd34ecde service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:22:03.818906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 835/1669] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:22:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:23:26.618584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:26.619154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:26.619276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:26.642957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:23:26.644145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:26.651563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 835/1670] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:23:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:23:26.660649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:26.661000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:26.661340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:26.685387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:23:26.686603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:26.694102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 836/1671] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:23:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:23:26.698931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:26.709149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f903d-0b37-4282-ad92-398f6208dff3 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:26.713656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:26.714346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:26.714683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:26.715012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:26.715782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:23:26.716133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:26.744660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:26.758484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 836/1672] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:23:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:23:26.768691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:26.777760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4523e-a0ca-4ba3-9a3b-97d08e8eddb9 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:26.782259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:26.782905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:26.783238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:26.783565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:26.784278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:26.812472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:26.913364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 837/1673] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:23:26 2021] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:23:26.918171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:26.928292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8c10-ce6f-4796-933a-1c67d91c3555 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:26.995581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:26.996262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:26.996601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:26.996932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:26.997647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:27.026929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:27.086462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 837/1674] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:23:26 2021] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:23:27.090856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:27.101329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d233-52cd-4634-8876-ca47d2ddca17 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:27.106328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:27.107014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.107399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.107668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.108457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:27.138067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e63b22-0017-4ae6-b5ab-78b6c4be1fa5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:27.149412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 838/1675] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:23:27 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:23:27.153960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:27.164138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30600f8f-f0a5-475b-bc0b-adca2ef396b7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:27.168849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:27.169746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.170126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.170454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] PATH_INFO: `/v3/projects/6c6391810ecb462dbf524a86ce12785e/users/c2a4f369a0f34d7d93e8eda3ac37c822/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.192274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6391810ecb462dbf524a86ce12785e, user_id=c2a4f369a0f34d7d93e8eda3ac37c822, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:27.220974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:27.286129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 838/1676] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:23:27 2021] PUT /identity/v3/projects/6c6391810ecb462dbf524a86ce12785e/users/c2a4f369a0f34d7d93e8eda3ac37c822/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:23:27.300012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18f36-6c8e-4bce-bd9c-b16dbd3d7ceb None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.300370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18f36-6c8e-4bce-bd9c-b16dbd3d7ceb None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.300709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f18f36-6c8e-4bce-bd9c-b16dbd3d7ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.340107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d7f18f36-6c8e-4bce-bd9c-b16dbd3d7ceb None None] MFA Rules not processed for user `c2a4f369a0f34d7d93e8eda3ac37c822`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:23:27.341314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d7f18f36-6c8e-4bce-bd9c-b16dbd3d7ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:27.415109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 839/1677] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:23:27 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:23:27.426876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:27.506539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62502d-595d-47ed-ac35-cf9025edcd0f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:27.511954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:27.512609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.512946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.513278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.521315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:27.550315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:27.559244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 839/1678] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:23:27 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:23:27.638220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e17f-fe24-48fb-951f-ec0a816e10e8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.638618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e17f-fe24-48fb-951f-ec0a816e10e8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.638881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8e17f-fe24-48fb-951f-ec0a816e10e8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.640624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 840/1679] 10.222.0.18 () {52 vars in 819 bytes} [Sat Aug 21 12:23:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:23:27.644589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:27.716443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c00fb-4539-4cf6-8b66-3a0aa9595965 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:27.721496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:27.722443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.722783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.723115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] PATH_INFO: `/v3/users/c2a4f369a0f34d7d93e8eda3ac37c822` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:27.724340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a4f369a0f34d7d93e8eda3ac37c822)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:27.752295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:23:27.752295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:23:27.752295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:23:27.753658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:27.931426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a4f369a0f34d7d93e8eda3ac37c822'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:27.941403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a4f369a0f34d7d93e8eda3ac37c822'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:27.971258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a4f369a0f34d7d93e8eda3ac37c822'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:27.971860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a4f369a0f34d7d93e8eda3ac37c822'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:27.987601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a4f369a0f34d7d93e8eda3ac37c822'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:27.994106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 840/1680] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:23:27 2021] DELETE /identity/v3/users/c2a4f369a0f34d7d93e8eda3ac37c822 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:23:27.998824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:27.999172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:27.999506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:28.023023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:23:28.024271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:28.094541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 841/1681] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:23:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:23:28.105174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:28.106648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:28.174250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed156-1967-4445-a42a-c577d3bd7b16 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:28.177989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:28.178649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:28.178992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:28.179326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:28.189283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:28.217019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8075b-71de-47f4-9ce2-ceb56f94938f service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:28.227189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 841/1682] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:23:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:23:28.884316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:23:28.885869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:23:28.898430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feefdca-2780-4e47-8342-327dce727c3b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:23:28.903301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:23:28.904098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:23:28.904355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:23:28.904701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] PATH_INFO: `/v3/projects/6c6391810ecb462dbf524a86ce12785e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:23:28.905897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6391810ecb462dbf524a86ce12785e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:23:28.933983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:23:28.933983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:23:28.933983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:23:28.935322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:23:29.023708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6391810ecb462dbf524a86ce12785e', 'request_id': 'req-1029981c-136e-4a42-98fe-82d63df859b0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:29.028997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6391810ecb462dbf524a86ce12785e', 'request_id': 'req-1029981c-136e-4a42-98fe-82d63df859b0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:29.106589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6391810ecb462dbf524a86ce12785e', 'request_id': 'req-1029981c-136e-4a42-98fe-82d63df859b0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:29.148639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] The token cache is being invalidate because project 6c6391810ecb462dbf524a86ce12785e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:23:29.148969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:29.149669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1029981c-136e-4a42-98fe-82d63df859b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:23:29.151479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 842/1683] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:23:28 2021] DELETE /identity/v3/projects/6c6391810ecb462dbf524a86ce12785e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:24:54.479182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343daf3-74de-4cd0-9329-deb25aa98cc3 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:54.479771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343daf3-74de-4cd0-9329-deb25aa98cc3 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:54.479903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343daf3-74de-4cd0-9329-deb25aa98cc3 None None] PATH_INFO: `/v3` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:54.481182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 842/1684] 10.222.0.35 () {54 vars in 916 bytes} [Sat Aug 21 12:24:54 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:24:54.487685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f52e-4bca-489a-beba-39fac9ec50f9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:54.488116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f52e-4bca-489a-beba-39fac9ec50f9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:54.488536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61f52e-4bca-489a-beba-39fac9ec50f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:54.512834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ec61f52e-4bca-489a-beba-39fac9ec50f9 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:24:54.514099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ec61f52e-4bca-489a-beba-39fac9ec50f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:24:54.586576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 843/1685] 10.222.0.35 () {58 vars in 1006 bytes} [Sat Aug 21 12:24:54 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:24:55.316524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:55.316524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:55.316524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:55.316524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 843/1686] 127.0.0.1 () {54 vars in 890 bytes} [Sat Aug 21 12:24:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:24:55.316978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a687a9-1328-44e0-8bc8-e51227a123d2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:55.316978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a687a9-1328-44e0-8bc8-e51227a123d2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:55.316978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a687a9-1328-44e0-8bc8-e51227a123d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:55.337972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-58a687a9-1328-44e0-8bc8-e51227a123d2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:24:55.339176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-58a687a9-1328-44e0-8bc8-e51227a123d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:24:55.405226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 844/1687] 127.0.0.1 () {58 vars in 988 bytes} [Sat Aug 21 12:24:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:24:55.544865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:24:55.546645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:24:55.632475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44160191-3b84-4a54-8781-d069c31abaa7 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:24:55.637646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:24:55.638342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:55.638677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:55.639004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:55.647476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:24:55.676628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad159a4-ad81-46b8-b0bc-88fc07230623 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:24:55.686111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 844/1688] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:24:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:24:57.268340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8fd6-ef3b-475b-a7dc-be1fa8fe0d0e None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:57.268850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8fd6-ef3b-475b-a7dc-be1fa8fe0d0e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:57.268956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8fd6-ef3b-475b-a7dc-be1fa8fe0d0e None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:57.270912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 845/1689] 127.0.0.1 () {54 vars in 890 bytes} [Sat Aug 21 12:24:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:24:57.275986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7945e-acce-436b-a74f-9bfc3d4c5a3c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:57.276336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7945e-acce-436b-a74f-9bfc3d4c5a3c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:57.276672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7945e-acce-436b-a74f-9bfc3d4c5a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:57.376070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f5e7945e-acce-436b-a74f-9bfc3d4c5a3c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:24:57.377353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f5e7945e-acce-436b-a74f-9bfc3d4c5a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:24:57.385110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 845/1690] 127.0.0.1 () {58 vars in 988 bytes} [Sat Aug 21 12:24:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:24:57.522889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8fd6-ef3b-475b-a7dc-be1fa8fe0d0e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:24:57.538026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8fd6-ef3b-475b-a7dc-be1fa8fe0d0e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:24:57.543632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:24:57.544276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:57.544615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:57.544945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:57.553443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:24:57.581693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e414009-9835-41f0-891b-af7f68ef09ed service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:24:57.591193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 846/1691] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:24:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:24:58.307469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f776-00a6-4935-a520-9815172fd516 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:58.307892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f776-00a6-4935-a520-9815172fd516 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:58.308144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f776-00a6-4935-a520-9815172fd516 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:58.309940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 846/1692] 10.222.0.18 () {54 vars in 949 bytes} [Sat Aug 21 12:24:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:24:58.315738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4a7f-7718-4608-82cb-7eef92bbf274 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:58.316089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4a7f-7718-4608-82cb-7eef92bbf274 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:58.316423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc4a7f-7718-4608-82cb-7eef92bbf274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:58.340146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-39dc4a7f-7718-4608-82cb-7eef92bbf274 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:24:58.341335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-39dc4a7f-7718-4608-82cb-7eef92bbf274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:24:58.349636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 847/1693] 10.222.0.18 () {58 vars in 1047 bytes} [Sat Aug 21 12:24:58 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:24:58.357322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f776-00a6-4935-a520-9815172fd516 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:24:58.371167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f776-00a6-4935-a520-9815172fd516 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:24:58.375996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:24:58.376626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:24:58.376959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:24:58.377951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:24:58.386391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:24:58.414879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60d95f-d533-4870-8115-8cc9fc5e882b service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:24:58.424863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 847/1694] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:24:58 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:09.581065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607e97-9269-43b2-853f-7ab048acd496 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:09.581633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607e97-9269-43b2-853f-7ab048acd496 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:09.581739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73607e97-9269-43b2-853f-7ab048acd496 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:09.583553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 848/1695] 127.0.0.1 () {54 vars in 890 bytes} [Sat Aug 21 12:25:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:09.588789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a580e2-d9cb-4994-8db3-3bc4e0142140 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:09.589138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a580e2-d9cb-4994-8db3-3bc4e0142140 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:09.589515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a580e2-d9cb-4994-8db3-3bc4e0142140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:09.613735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-90a580e2-d9cb-4994-8db3-3bc4e0142140 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:09.614989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-90a580e2-d9cb-4994-8db3-3bc4e0142140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:09.622430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 848/1696] 127.0.0.1 () {58 vars in 988 bytes} [Sat Aug 21 12:25:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:09.760084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73607e97-9269-43b2-853f-7ab048acd496 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:09.775315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73607e97-9269-43b2-853f-7ab048acd496 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:09.780951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:09.781599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:09.782008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:09.782342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:09.791253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:09.819721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fb18c-70d4-480f-ad3d-2c7be32d0e0e service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:09.829363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 849/1697] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:11.396609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812869-fe3f-4ceb-86fb-7cf0388622f5 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:11.397172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812869-fe3f-4ceb-86fb-7cf0388622f5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:11.397291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a812869-fe3f-4ceb-86fb-7cf0388622f5 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:11.399119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 849/1698] 127.0.0.1 () {54 vars in 890 bytes} [Sat Aug 21 12:25:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:11.404167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8187-1811-41b1-8631-7b6e06a066b5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:11.404521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8187-1811-41b1-8631-7b6e06a066b5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:11.404860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8187-1811-41b1-8631-7b6e06a066b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:11.429031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bb5d8187-1811-41b1-8631-7b6e06a066b5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:11.430285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bb5d8187-1811-41b1-8631-7b6e06a066b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:11.437779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 850/1699] 127.0.0.1 () {58 vars in 988 bytes} [Sat Aug 21 12:25:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:11.576101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a812869-fe3f-4ceb-86fb-7cf0388622f5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:11.591358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a812869-fe3f-4ceb-86fb-7cf0388622f5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:11.596766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:11.597415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:11.597753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:11.598137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:11.606608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:11.635088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129bbd78-29b1-4190-9cbe-afb84748bd98 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:11.645201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 850/1700] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:15.517169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf02d3-6d6b-4694-83a3-4958a6d5ed3f None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:15.517759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf02d3-6d6b-4694-83a3-4958a6d5ed3f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:15.518015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf02d3-6d6b-4694-83a3-4958a6d5ed3f None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:15.519915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 851/1701] 127.0.0.1 () {54 vars in 905 bytes} [Sat Aug 21 12:25:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:15.525325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:15.525671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:15.526063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:15.550429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:15.551626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:15.559413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 851/1702] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:15.584074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbc65-cdd2-49be-bce2-867df0b7dafd None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:15.584418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbc65-cdd2-49be-bce2-867df0b7dafd None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:15.584750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacbc65-cdd2-49be-bce2-867df0b7dafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:15.607977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9aacbc65-cdd2-49be-bce2-867df0b7dafd None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:15.609168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9aacbc65-cdd2-49be-bce2-867df0b7dafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:15.617042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 852/1703] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:15.636551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:15.638023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:15.704166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac15515-c329-453c-bef7-3f4eea4bafa9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:15.707860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:15.708511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:15.708850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:15.709183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:15.718510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:15.746532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b339e-e3e2-4f7b-90be-80f44b3a142f service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:15.756497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 852/1704] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:17.748957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc342-46e9-4092-bc2a-e8079afda36b None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:17.749534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc342-46e9-4092-bc2a-e8079afda36b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:17.749662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc342-46e9-4092-bc2a-e8079afda36b None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:17.751476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 853/1705] 127.0.0.1 () {54 vars in 905 bytes} [Sat Aug 21 12:25:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:17.757664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:17.758050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:17.758391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:17.782880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:17.784090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:17.791930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 853/1706] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:17.817232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df34-4acf-435f-a348-97b547b61f5d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:17.817576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df34-4acf-435f-a348-97b547b61f5d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:17.817941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795df34-4acf-435f-a348-97b547b61f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:17.841284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7795df34-4acf-435f-a348-97b547b61f5d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:17.842538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7795df34-4acf-435f-a348-97b547b61f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:17.850122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 854/1707] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:17.869148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:17.879133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf2a15-39f4-4ee2-a9d7-be0de8c3c2a4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:17.882750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:17.883396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:17.883732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:17.884063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:17.894415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:17.923880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef9aee-0dae-4e3d-b7a4-a6cbc95b453b service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:17.933897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 854/1708] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:21.481570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b748-8b05-4370-bd95-a32e8f86207c None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:21.482187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b748-8b05-4370-bd95-a32e8f86207c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:21.482310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3b748-8b05-4370-bd95-a32e8f86207c None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:21.484120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 855/1709] 127.0.0.1 () {54 vars in 905 bytes} [Sat Aug 21 12:25:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:21.490942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:21.491287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:21.491621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:21.516128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:21.517347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:21.524852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 855/1710] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:21.574938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad7b1-aaab-41b5-97ff-66e51ddb269e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:21.575290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad7b1-aaab-41b5-97ff-66e51ddb269e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:21.575624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ad7b1-aaab-41b5-97ff-66e51ddb269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:21.599492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c76ad7b1-aaab-41b5-97ff-66e51ddb269e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:21.600684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c76ad7b1-aaab-41b5-97ff-66e51ddb269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:21.608005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 856/1711] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:21.620659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:21.622164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:21.687807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7bb1b-4fa1-4e85-9e51-cdf40913de44 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:21.691470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:21.692119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:21.692457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:21.692785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:21.702038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:21.730187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a0c96-4ffe-49fb-bdc4-615cd8c4b54a service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:21.740282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 856/1712] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:25:23.713911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0496fc-93f7-40d5-bd3a-61f210ca0852 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.714486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0496fc-93f7-40d5-bd3a-61f210ca0852 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.714605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0496fc-93f7-40d5-bd3a-61f210ca0852 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.716367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 857/1713] 127.0.0.1 () {54 vars in 905 bytes} [Sat Aug 21 12:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:23.722353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc687f6-3f84-4386-b27d-5dae6ab2904b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.722705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc687f6-3f84-4386-b27d-5dae6ab2904b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.723042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc687f6-3f84-4386-b27d-5dae6ab2904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.747775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9cc687f6-3f84-4386-b27d-5dae6ab2904b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:23.749021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9cc687f6-3f84-4386-b27d-5dae6ab2904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:23.756504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 857/1714] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:23.812466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ee065-1a53-4c4b-adda-dbbc38e471bc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.812809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ee065-1a53-4c4b-adda-dbbc38e471bc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.813140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ee065-1a53-4c4b-adda-dbbc38e471bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.836378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b39ee065-1a53-4c4b-adda-dbbc38e471bc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:23.837569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b39ee065-1a53-4c4b-adda-dbbc38e471bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:23.844947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 858/1715] 127.0.0.1 () {58 vars in 1003 bytes} [Sat Aug 21 12:25:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:23.857289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab62a-ec8f-4ded-a8f5-2e155b51b1f6 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.857646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab62a-ec8f-4ded-a8f5-2e155b51b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.858012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ab62a-ec8f-4ded-a8f5-2e155b51b1f6 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.859855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 858/1716] 10.222.0.18 () {54 vars in 950 bytes} [Sat Aug 21 12:25:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:25:23.865451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fa98-21e0-4810-98f6-dc673b20b834 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.865820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fa98-21e0-4810-98f6-dc673b20b834 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.866174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337fa98-21e0-4810-98f6-dc673b20b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.889290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f337fa98-21e0-4810-98f6-dc673b20b834 None None] MFA Rules not processed for user `8c3cbfabf9954b87b9a13bf68684d0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:25:23.890507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f337fa98-21e0-4810-98f6-dc673b20b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:25:23.896627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 859/1717] 10.222.0.18 () {58 vars in 1048 bytes} [Sat Aug 21 12:25:23 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:25:23.904238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ab62a-ec8f-4ded-a8f5-2e155b51b1f6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:25:23.916042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ab62a-ec8f-4ded-a8f5-2e155b51b1f6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:25:23.919621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:25:23.920253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:25:23.920589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:25:23.920917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:25:23.930749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:25:23.959102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34f3f2-b84f-4217-a860-61f363bf4c50 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:25:23.969554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 859/1718] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:25:23 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:26:57.950828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:57.951422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:57.951519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:57.987167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:57.988424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.000527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 860/1719] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.010830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8e0f-d0f6-427f-aae9-06b08c4bb6a5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.011177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8e0f-d0f6-427f-aae9-06b08c4bb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.011491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8e0f-d0f6-427f-aae9-06b08c4bb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.060311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-39ee8e0f-d0f6-427f-aae9-06b08c4bb6a5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.062082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-39ee8e0f-d0f6-427f-aae9-06b08c4bb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.079433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 860/1720] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.084991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.101529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240f36a-7519-43a2-a0b7-e585f2d4ef67 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.111838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.113060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.113401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.113775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.116128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198ce6-184a-465f-9e13-686c8b1de0e0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.116466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198ce6-184a-465f-9e13-686c8b1de0e0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.116810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05198ce6-184a-465f-9e13-686c8b1de0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.120052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:58.120439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.163881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-05198ce6-184a-465f-9e13-686c8b1de0e0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.165128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-05198ce6-184a-465f-9e13-686c8b1de0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.179652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ce4f0-9604-431f-aecc-819965ebf651 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.189862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 861/1721] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:26:58.200302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128bc1-97b6-466b-bfcc-b63534148c59 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.200672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128bc1-97b6-466b-bfcc-b63534148c59 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.201010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10128bc1-97b6-466b-bfcc-b63534148c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.230943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 861/1722] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:58.232346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.232692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.233028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.259830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-10128bc1-97b6-466b-bfcc-b63534148c59 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.261103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-10128bc1-97b6-466b-bfcc-b63534148c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.281287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 862/1723] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.282460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043e9c-c0c7-48b3-91d8-022be16d09a1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.282801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043e9c-c0c7-48b3-91d8-022be16d09a1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.283133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043e9c-c0c7-48b3-91d8-022be16d09a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.288706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.290672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.308735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 862/1724] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.309753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.331932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ac7a8-837e-4dbe-b5a0-a8eb6459b4ee None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.334401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f0043e9c-c0c7-48b3-91d8-022be16d09a1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.335732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f0043e9c-c0c7-48b3-91d8-022be16d09a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.338014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.339161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.339775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.340225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.341071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.345590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 863/1725] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.347112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be494e-93ce-44a6-adf9-03cbe7a904e2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.347625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be494e-93ce-44a6-adf9-03cbe7a904e2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.348122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be494e-93ce-44a6-adf9-03cbe7a904e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.372432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba7024-f964-4605-9031-ecb9f05e1be4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.373374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-35be494e-93ce-44a6-adf9-03cbe7a904e2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.374810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-35be494e-93ce-44a6-adf9-03cbe7a904e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.382541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 864/1726] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.383812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.384308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.384647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.411073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.412538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.423838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 865/1727] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.423838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.430380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d9145-48a4-4fa5-8c91-0851f017a9bb None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.434921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.435917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.435917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.436281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.436927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:58.437275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.467090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca329cc-e941-485d-b55a-5dba01eb8957 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.483193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 866/1728] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:58.487572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8351-4523-4dd3-9c23-f16102d40a45 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.487572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8351-4523-4dd3-9c23-f16102d40a45 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.487572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f8351-4523-4dd3-9c23-f16102d40a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.497803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 863/1729] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:58.497803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf400f1-bcca-4fcc-9314-2f4ccc77f7f1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.497803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf400f1-bcca-4fcc-9314-2f4ccc77f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.497803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf400f1-bcca-4fcc-9314-2f4ccc77f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.512334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c24f8351-4523-4dd3-9c23-f16102d40a45 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.513595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c24f8351-4523-4dd3-9c23-f16102d40a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.524997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0bf400f1-bcca-4fcc-9314-2f4ccc77f7f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.526216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0bf400f1-bcca-4fcc-9314-2f4ccc77f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.583895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 867/1730] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.585360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa958f-4ab0-40d6-88cb-124bf9c9187a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.585823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa958f-4ab0-40d6-88cb-124bf9c9187a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.586294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa958f-4ab0-40d6-88cb-124bf9c9187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.595010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 864/1731] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.599048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.599399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.599739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.610501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-54fa958f-4ab0-40d6-88cb-124bf9c9187a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.611717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-54fa958f-4ab0-40d6-88cb-124bf9c9187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.620203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 868/1732] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.621483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.621847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.622182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.623812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.625703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.635189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 865/1733] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.636085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.645708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba9cd-52f7-49f3-b2c6-00e3a43d8de9 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.649036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.650259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.650430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.650916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.651259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.651593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.652370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:58.652754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.658714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 869/1734] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.659342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.672610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b3eb3-033c-40de-a9af-23726fcf9342 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.677335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.678072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.678406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.678731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.679491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.687330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.703113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 866/1735] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:58.703113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.712620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eee224-c696-478b-8cf0-c9dea56dab77 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.712779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08410-fccb-485f-993a-f6839f3ba4bb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.716893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.717602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.717957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.718784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.719513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.748214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.761495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 870/1736] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:58.764185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7083-f258-4277-bb96-7821ffc641b4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.764185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7083-f258-4277-bb96-7821ffc641b4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.764185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7083-f258-4277-bb96-7821ffc641b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.787692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fc9e7083-f258-4277-bb96-7821ffc641b4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.788939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fc9e7083-f258-4277-bb96-7821ffc641b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.852035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 867/1737] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:58.852035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.860661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 871/1738] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.862704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae66-22fd-45cb-a86e-9563f4db0c5a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.863046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae66-22fd-45cb-a86e-9563f4db0c5a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.863384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fae66-22fd-45cb-a86e-9563f4db0c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.864823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca461f9-7ec3-4ed5-8b7c-90d45312040c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.869651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.873191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.873191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.873191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.873191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:58.873191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.887039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-726fae66-22fd-45cb-a86e-9563f4db0c5a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.888262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-726fae66-22fd-45cb-a86e-9563f4db0c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.896526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 872/1739] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.896526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.896526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.896526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.903232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.918818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 868/1740] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:58.918818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.928486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:26:58.928486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:26:58.931189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 873/1741] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:26:58.934931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:58.935089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bab68-7bff-45a9-a181-d3055b0d7e0d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.940394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.941061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.941401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.941735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.941890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6551762-7d87-4596-858b-4b3b4258e251 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:58.942551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:58.942904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.946542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:58.947181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:58.947520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:58.947853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:58.948572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:58.973124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:58.977366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.000678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 869/1742] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:59.000678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.000678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db92f9-a930-408e-9e3a-35093bc4bdf2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.005414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.006130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.006476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.006814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.007620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.037710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 874/1743] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.037951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.038069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.087029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 870/1744] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:26:58 2021] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.087029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.097058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e750b-904f-4bf5-a58a-680ec11f56ff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.113508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd7b7a-7576-4189-841a-4a462e08aaac admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.118223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.118897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.119241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.119572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.120351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.149239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.166299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 875/1745] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:26:59.166299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.168794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.169106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.169431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.169766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.170578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:59.170935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.171906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b05d39-8eb2-4516-ae1f-77b5fcccbe5c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.176453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.177092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.177427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.177756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.178547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:59.178895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.199007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.207137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.212954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 871/1746] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:59.213463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.223871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f04f-6414-4ef3-b9e4-411a98973a35 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.224006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 876/1747] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:59.224812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.234461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4c9ba-fa1c-4732-a8db-6b3110f12871 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.237068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.237842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.238186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.238519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.238957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.239247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.239580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.239916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.240249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.241009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:26:59.241358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.268007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.269644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.283791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 877/1748] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:26:59.284461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.294155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d1d75-fe67-495c-a046-2382d9626a8d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.299405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.300036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.302889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.302889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.302889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.330025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 872/1749] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.330025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.330311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.381374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 878/1750] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.381374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.403560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6034-6a18-48c1-9cb8-a6ebb66dddcc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.450569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4dacf-dea4-464b-8136-2ef522a44d38 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.455270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.455935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.456271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.456602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.457411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.469325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.470072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.470419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.470754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.471529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.486456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.497618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 879/1751] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:26:59.500936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.501078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.510938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad0e29-ee88-440a-8bce-36a6ca2cf166 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.515632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.520347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.520347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.520347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] PATH_INFO: `/v3/projects/00a1dd6cf8684d8ca9a4c0ebf8005a50/users/9dde5c55696947b881b9075938e3ee5e/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.540076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a1dd6cf8684d8ca9a4c0ebf8005a50, user_id=9dde5c55696947b881b9075938e3ee5e, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.547035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 873/1752] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.547035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.554378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344163-6146-4e6c-8ac8-7e50b08cac79 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.559130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.559820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.560164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.560501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.561225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.569865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.589505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.605521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 880/1753] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:26:59 2021] PUT /identity/v3/projects/00a1dd6cf8684d8ca9a4c0ebf8005a50/users/9dde5c55696947b881b9075938e3ee5e/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:26:59.606389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.642075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 874/1754] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.643304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.686878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0788b-15c7-4488-b1e3-fc56c6368452 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.724275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069cb30-905f-4268-812c-476488236ed0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.728865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.729531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.729927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.730266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.730998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.752453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.753146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.753488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.753851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.754582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.759261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.784416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.806929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 875/1755] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.807841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.839547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 881/1756] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:26:59.840480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:26:59.890327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1a6bd-6f87-4317-a16c-9be36fa20a73 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.916464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0d372-edf4-4c0e-8bb4-7219a6b6370e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:26:59.921027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.922261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.922595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.922921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.923642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.952880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:26:59.956560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:26:59.957251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:26:59.957589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:26:59.957953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:26:59.958678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:26:59.988062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.069573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 882/1757] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:00.070483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.080533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b69d6-7e7c-4ff5-83e8-9dc455e12109 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.085056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.090030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.090305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.090657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] PATH_INFO: `/v3/projects/2d22a0436c7d4e3eb4e033d44e8bad56/users/baaf75d8eaab4d1b91dbdd503c461bb1/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.111780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d22a0436c7d4e3eb4e033d44e8bad56, user_id=baaf75d8eaab4d1b91dbdd503c461bb1, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.119443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 876/1758] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:26:59 2021] POST /identity/v3/users => generated 285 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:00.119443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.127893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292c70a-9c2a-4b52-924f-e5ad8fb06367 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.132456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.133103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.133443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.133777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.134605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.141911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.163684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e5c43-0394-45fa-9e2c-bb42f2b63358 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.174769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 877/1759] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.176109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.176451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.176782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.188250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 883/1760] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:00 2021] PUT /identity/v3/projects/2d22a0436c7d4e3eb4e033d44e8bad56/users/baaf75d8eaab4d1b91dbdd503c461bb1/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:00.189217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.217286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] MFA Rules not processed for user `9dde5c55696947b881b9075938e3ee5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:00.218615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:00.266878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7231ad8-c038-42a1-b7f4-ecde68002cd0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.271600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.272280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.272623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.272959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.273684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.293834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 878/1761] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:00.294763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.302469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.305247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039f5ce-1f12-4ffd-913d-8055bb11e774 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.310060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.310822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.311427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.311645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.313061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.342323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.354702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 884/1762] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:00.355627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.365299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0260de-c63a-44f7-b1db-7222fc2565d2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.369815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.370483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.370853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.371182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.371891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.400208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 879/1763] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:00.401224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.401512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.411215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93ef97-7851-4687-9dc2-def38574a070 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.416106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.416760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.417104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.417442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.418277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.447320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.451367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 885/1764] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:00.452287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.459733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 880/1765] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.460575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.467571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5ee9a-af81-4ba1-9f41-29823b485e9e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.470232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd72b8-b60d-4b15-86d7-d07e3eb59018 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.472313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.473006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.473366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.473705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.474590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.474795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.475663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.475997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.476567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] PATH_INFO: `/v3/projects/8a85bc1c655148b88b864390d8aa1fe7/users/8b6165455d13434895121c88ea45e312/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.497585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a85bc1c655148b88b864390d8aa1fe7, user_id=8b6165455d13434895121c88ea45e312, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.504453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0f1f7-a612-4310-ba40-737356ecb68d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.520526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 886/1766] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.520526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.520526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.520526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.527558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1495a74-d23a-47ac-b38e-ee5545617022 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.555669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] MFA Rules not processed for user `baaf75d8eaab4d1b91dbdd503c461bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:00.556899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:00.586350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 881/1767] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:00 2021] PUT /identity/v3/projects/8a85bc1c655148b88b864390d8aa1fe7/users/8b6165455d13434895121c88ea45e312/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:00.587709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771ae6e-10ca-43da-8c6c-dad178142878 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.588081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771ae6e-10ca-43da-8c6c-dad178142878 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.588410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771ae6e-10ca-43da-8c6c-dad178142878 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.590206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 882/1768] 10.222.0.18 () {54 vars in 948 bytes} [Sat Aug 21 12:27:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:00.590959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771ae6e-10ca-43da-8c6c-dad178142878 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.643516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 887/1769] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:00.644545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.654670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27864e18-28ed-4e23-aa7f-b7b1ade55c80 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.665926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771ae6e-10ca-43da-8c6c-dad178142878 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.670444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.671637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.671980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.672317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.673107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.701548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.717774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 883/1770] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.717774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.722377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.723200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.723545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.723879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.724668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.727532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3e58b-f0f4-4509-8460-41e3d2eead87 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.732108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.732763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.733104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.733439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.734779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.753538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.763026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.769669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 888/1771] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.769669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.774233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 884/1772] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:00.775024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.775284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9e222-ec60-4bc1-92d9-fa21772f2c9f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.782460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.783364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.783705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.784039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] PATH_INFO: `/v3/projects/1787c3f7bec742019e6b49604067909b/users/4ee7748418bc498eafdc8b1a00917502/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.789182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8de71-5ae6-489d-b2eb-b35cf84dbe3a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.793743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.794648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.794985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.795315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] PATH_INFO: `/v3/projects/639950c274fc415db6ac0374a6d59468/users/60bb104168a74bb3a98108f151cc29a2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.805809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1787c3f7bec742019e6b49604067909b, user_id=4ee7748418bc498eafdc8b1a00917502, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.816580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639950c274fc415db6ac0374a6d59468, user_id=60bb104168a74bb3a98108f151cc29a2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:00.834932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bca56-cd3b-41de-a766-0ef01a71ae40 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.845864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b78b24-022c-418f-a340-d9c60502e2c6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:00.877426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 889/1773] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:00 2021] PUT /identity/v3/projects/1787c3f7bec742019e6b49604067909b/users/4ee7748418bc498eafdc8b1a00917502/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:00.878764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.879105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.879437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.894860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 885/1774] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:00 2021] PUT /identity/v3/projects/639950c274fc415db6ac0374a6d59468/users/60bb104168a74bb3a98108f151cc29a2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:00.896398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.896740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.897245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.902292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:00.903771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:00.923963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:00.925182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:00.977333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 890/1775] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:00.980419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:00.991601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96a63-45ce-424a-a7cb-92cc2278bd13 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:00.996577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:00.997250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:00.997597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:00.998139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:00.998836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.005419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 886/1776] 10.222.0.18 () {58 vars in 1046 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.006211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.017823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5d97f-88ec-4aa1-a98c-bbf264264c50 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.022458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.023352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.023693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.024310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] PATH_INFO: `/v3/projects/2306c82a20c54b8cb45c754e26de3439/users/6e43e097c35646c4a7cd85d247b9d398/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.028149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.047552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2306c82a20c54b8cb45c754e26de3439, user_id=6e43e097c35646c4a7cd85d247b9d398, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.077177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.119153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 887/1777] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:01 2021] PUT /identity/v3/projects/2306c82a20c54b8cb45c754e26de3439/users/6e43e097c35646c4a7cd85d247b9d398/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:01.119153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.119451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 891/1778] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:00 2021] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:01.119451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.190456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09a44-78c2-4741-bcb7-3542ee24b84b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.193715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc51e6c-2e66-4629-9992-5fb55e8d3da0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.195058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.195967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.196304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.196635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] PATH_INFO: `/v3/projects/ff473fa5bc80441891d03f064db2b627/users/bc0bbb7ae29740728b4ac4d8c1b84c02/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.198529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.199485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.199826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.200162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] PATH_INFO: `/v3/projects/d4336a5d52524343aa75776b3d08929b/users/69507673906f416b8ef8befb0e240329/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.217693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff473fa5bc80441891d03f064db2b627, user_id=bc0bbb7ae29740728b4ac4d8c1b84c02, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.221197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4336a5d52524343aa75776b3d08929b, user_id=69507673906f416b8ef8befb0e240329, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.248169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3b64-8ee1-45a8-aa21-b680806b6136 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.251293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ef74e-299b-4bee-8b1c-d3d4bd2d6bed admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.285068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 892/1779] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:01 2021] PUT /identity/v3/projects/ff473fa5bc80441891d03f064db2b627/users/bc0bbb7ae29740728b4ac4d8c1b84c02/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:01.286590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.286933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.287267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.308616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 888/1780] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:01 2021] PUT /identity/v3/projects/d4336a5d52524343aa75776b3d08929b/users/69507673906f416b8ef8befb0e240329/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:01.313681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.313681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.313681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.314054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:01.314054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.349501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] MFA Rules not processed for user `60bb104168a74bb3a98108f151cc29a2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:01.350771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.386440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 893/1781] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.387356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.388649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.430722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 889/1782] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.431634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.458258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393041-6855-4756-a2fb-5344c9f297bc None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.462098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.462760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.463103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.463438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.473040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.502643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574095e-f9f2-4b61-b557-434306713628 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.512507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 894/1783] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:01.512661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257626cf-bf04-4d73-b7bc-d0299fdaf99c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.513773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.514143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.514476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.518294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.518960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.519305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.519647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.538655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:01.539821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.548257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 895/1784] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.548893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.558472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d6119-eb45-472e-8d6d-63c892fa5a59 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.563659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.564325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.564660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.564988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.565707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.592361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.594814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea854c3-6cdc-45b9-b907-05d062392437 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.620574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31067e88-81cb-4da2-b0ed-cb13dbe65e23 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.631182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 890/1785] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:01.632509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.632856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.633273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.662255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 896/1786] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:01.663820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.664471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.664663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.680736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] MFA Rules not processed for user `bc0bbb7ae29740728b4ac4d8c1b84c02`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:01.682980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.692754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:01.694111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:01.701743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 897/1787] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.702701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.712511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c5d9-17ee-43f7-abb6-09ac2ce1ef26 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.716961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.720828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.720828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.720828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.728889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.757650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.768562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 898/1788] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:01.769428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.772483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 891/1789] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:01.775165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.781903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda31f1-0e84-4eb5-9988-76f3f6f5640e service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.788471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.789211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.789450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a003e-5940-49f5-92e2-bb904e34ff87 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.789812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.790162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.790960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.793426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.794303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.794491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.794809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.806263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.823717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.838442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.850651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 892/1790] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:01.851735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.862548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d90be-3742-453b-9844-a27ecd0f8d0e service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.867861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.868509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.868955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.869549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:01.870469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:01.891482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 899/1791] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:01.891482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.903258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:01.917091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 893/1792] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:01.918148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:01.928790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667265f-5150-44c9-9423-0b9a0ed0cdfe admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.985588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31466889-61bc-4834-b433-ab3ee47df929 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:01.989509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:01.990294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:01.990713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:01.991134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.028061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.028505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.028505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.028840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.029574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.059335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.076153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.105143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.116558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 900/1793] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:02.117323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.118607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 894/1794] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:01 2021] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:02.120040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.130970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd883c-a8cb-4990-9580-b91c3cff7c22 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.195854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97864f8b-54bd-4240-b641-6788441b5484 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.200305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.201147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.201768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.202713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.236607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.237298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.237639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.238012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.238742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.269619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.298625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.329119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.342212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 895/1795] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:02 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:02.343633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.354079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd74d59-8983-48b8-9d68-700237ca7321 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.356623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 901/1796] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:02 2021] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:02.357589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.362910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.363932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.364346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.364754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] PATH_INFO: `/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.375622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de43caf-f8e5-443d-83c6-7f7b9b287c52 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.389693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f327caf86104a169744a8405d068600, user_id=5b28b5706e5642b49a531b3848bd9d10, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.406193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.410085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.410426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.411015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.412028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.422254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.481271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.493247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 896/1797] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:02 2021] PUT /identity/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:02.494417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.599236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 902/1798] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:02 2021] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:02.603816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.631491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430d3f8-f735-40d9-bc7a-7c0da9cd944c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.640260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c46aa-ffda-483a-aea9-6f3c9f0c6dbe admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.642892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.643827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.644496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.645041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.646207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.651180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.651886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.652231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.652569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.653373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.715184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.727365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.741092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 903/1799] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:02 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:02.743898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.761734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 897/1800] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:02 2021] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:02.763524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.766483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12367bde-3b7e-4e3f-9bf0-174bc2aeea01 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.775821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfcf95-6c1a-429a-9bd1-45ec1088a373 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.777250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.778955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.780096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.782194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.782335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.782860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.783621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.784052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.784477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] PATH_INFO: `/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.787340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f327caf86104a169744a8405d068600, user_id=5b28b5706e5642b49a531b3848bd9d10, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:02.826460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.831274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:02.840150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 904/1801] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:02 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:02.841052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.846969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 898/1802] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:02 2021] PUT /identity/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:02.850784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:02.854388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ef96-a9a1-4f47-8288-9407e42eb944 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:02.951176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:02.953233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:02.953629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:02.953974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] PATH_INFO: `/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:02.985411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33053cc4ae1457fb692d1de69620450, user_id=de88994c917c4a49b4eecd8d60b5f97d, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.023628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.051178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2802b-2766-45a7-a963-c46846110856 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.056423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.056955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.057291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.057626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] PATH_INFO: `/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.076251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 905/1803] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:02 2021] PUT /identity/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:03.079641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dde8ae6d0ba48efb18c77426437add9, user_id=7489c32b27774f5d8900e50a6b815eef, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.081158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.119427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.175116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095dd85-b6b1-4a85-b43d-9a90066685cf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.189055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 899/1804] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:02 2021] PUT /identity/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:03.191278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.301980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.303068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.303609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.304285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.305629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.331826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabc5a1-7691-4cbd-9cdd-4f4da734fc1e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.337041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.337919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.338370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.338822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.339737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.348905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.364718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 906/1805] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:03.364718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.371130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.373398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d3760-d7ad-4b90-9cb2-ccc23ba3b636 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.379562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.381240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.385377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.385377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.385377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.396875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 900/1806] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:03.398511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.411786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e4007-d263-458d-abf4-1898c735767e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.419092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.429190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.430172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.430518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.430853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] PATH_INFO: `/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.436031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 907/1807] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:03.436031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.442419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f327caf86104a169744a8405d068600, user_id=5b28b5706e5642b49a531b3848bd9d10, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.448807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c89e-ba09-44c2-953c-e35c36fed4eb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.461025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.462016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.462530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.462889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] PATH_INFO: `/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.466192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33053cc4ae1457fb692d1de69620450, user_id=de88994c917c4a49b4eecd8d60b5f97d, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.486619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.505446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.517588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 908/1808] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:03 2021] PUT /identity/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:03.521237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.545407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 901/1809] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:03 2021] PUT /identity/v3/projects/3f327caf86104a169744a8405d068600/users/5b28b5706e5642b49a531b3848bd9d10/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:03.551434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.659588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb7d2ce-99f0-459f-a5b1-816816c76dfd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.667181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.667924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.668262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.668599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.670511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.671328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558316-3e6a-49ee-89d2-70dba3209ee3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.676347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.677262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.677596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.677974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] PATH_INFO: `/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.680309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dde8ae6d0ba48efb18c77426437add9, user_id=7489c32b27774f5d8900e50a6b815eef, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:03.731932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.739584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78cfce-d0b5-41ab-8216-401874e8826b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:03.754148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 902/1811] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:03.758292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 909/1811] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:03 2021] PUT /identity/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:03.759323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.759446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.759763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:03.760562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:03.840108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] MFA Rules not processed for user `5b28b5706e5642b49a531b3848bd9d10`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:03.843662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:03.976032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef7c73-0e72-49b8-a0f5-5397c60f73ba admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:03.978196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 903/1812] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:03 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:03.979474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:03.995296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:03.997604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:03.999804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad1172-d509-4015-b10e-c8f9b0f8e3fc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:04.001202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.001902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.004796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:04.005564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:04.007005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.007455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.007897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] PATH_INFO: `/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.010070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33053cc4ae1457fb692d1de69620450, user_id=de88994c917c4a49b4eecd8d60b5f97d, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:04.044098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:04.086268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1cefd-989f-4f5f-bd0a-482eb1129a71 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:04.107136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 904/1813] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:03 2021] PUT /identity/v3/projects/c33053cc4ae1457fb692d1de69620450/users/de88994c917c4a49b4eecd8d60b5f97d/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:04.108071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:04.136129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 910/1814] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:03 2021] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:04.141697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.142096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.142436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.254005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] MFA Rules not processed for user `de88994c917c4a49b4eecd8d60b5f97d`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:04.255580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:04.317199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5980374-418c-46fc-83d6-ae4fc45dc516 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:04.328678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:04.329599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.329968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.330302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] PATH_INFO: `/v3/users/baaf75d8eaab4d1b91dbdd503c461bb1` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.331518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaf75d8eaab4d1b91dbdd503c461bb1)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:04.399031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:27:04.399031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:27:04.399031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:27:04.400503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:04.430008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 911/1815] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:04 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:04.431673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:04.453065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7352e1-1439-45f1-ac2f-8e2a67a3cd62 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:04.458775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:04.466564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.466910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.467248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] PATH_INFO: `/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.470773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dde8ae6d0ba48efb18c77426437add9, user_id=7489c32b27774f5d8900e50a6b815eef, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:04.516188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04243343-a342-4ee5-8611-aea54d9b76ac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:04.559502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 912/1816] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:04 2021] PUT /identity/v3/projects/9dde8ae6d0ba48efb18c77426437add9/users/7489c32b27774f5d8900e50a6b815eef/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:04.571066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599d44c-a8bd-4007-b5ad-0a27f2e96f39 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.571413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599d44c-a8bd-4007-b5ad-0a27f2e96f39 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.571750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599d44c-a8bd-4007-b5ad-0a27f2e96f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.633274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaf75d8eaab4d1b91dbdd503c461bb1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:04.640436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0599d44c-a8bd-4007-b5ad-0a27f2e96f39 None None] MFA Rules not processed for user `4ee7748418bc498eafdc8b1a00917502`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:04.642832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0599d44c-a8bd-4007-b5ad-0a27f2e96f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:04.644353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaf75d8eaab4d1b91dbdd503c461bb1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:04.696858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaf75d8eaab4d1b91dbdd503c461bb1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:04.697849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaf75d8eaab4d1b91dbdd503c461bb1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:04.729742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaf75d8eaab4d1b91dbdd503c461bb1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:04.739497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 905/1817] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:04 2021] DELETE /identity/v3/users/baaf75d8eaab4d1b91dbdd503c461bb1 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:04.740807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:04.743263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:04.794490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 913/1818] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:04 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:04.800387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69199dab-cba9-4159-877b-56410dc93ca8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.802267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69199dab-cba9-4159-877b-56410dc93ca8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.802812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69199dab-cba9-4159-877b-56410dc93ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.831375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913b14-99ca-4c43-909b-b978c67da931 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:04.838128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:04.838807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.839211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.839546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.843655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:04.872825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-69199dab-cba9-4159-877b-56410dc93ca8 None None] MFA Rules not processed for user `7489c32b27774f5d8900e50a6b815eef`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:04.873964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69199dab-cba9-4159-877b-56410dc93ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:04.976302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:04.978430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 914/1819] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:04 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:04.983082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fcd3-4635-464c-8ba4-726997525e92 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.983082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fcd3-4635-464c-8ba4-726997525e92 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.983082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8fcd3-4635-464c-8ba4-726997525e92 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:04.983082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 915/1820] 10.222.0.18 () {54 vars in 948 bytes} [Sat Aug 21 12:27:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:04.984358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf66d-e7a8-465f-acd4-f052de9e8084 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:04.984781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf66d-e7a8-465f-acd4-f052de9e8084 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:04.985194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edf66d-e7a8-465f-acd4-f052de9e8084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.009687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-99edf66d-e7a8-465f-acd4-f052de9e8084 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:05.011091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-99edf66d-e7a8-465f-acd4-f052de9e8084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.018567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12377b3-562d-4cea-af81-c146e7c22e1e service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.061070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 906/1821] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:04 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:05.061070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660bb1-83af-47e9-9c14-35756266729e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.061070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660bb1-83af-47e9-9c14-35756266729e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.061070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660bb1-83af-47e9-9c14-35756266729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.097386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-20660bb1-83af-47e9-9c14-35756266729e None None] MFA Rules not processed for user `4ee7748418bc498eafdc8b1a00917502`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:05.099360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-20660bb1-83af-47e9-9c14-35756266729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.122856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 916/1822] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:05.124263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.124598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.124928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.154267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:05.156147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.188529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 907/1823] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:05 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:05.189467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20660bb1-83af-47e9-9c14-35756266729e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.190866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-20660bb1-83af-47e9-9c14-35756266729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.203784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20660bb1-83af-47e9-9c14-35756266729e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.207872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.208536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.208878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.209211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.220263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:05.249572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.261139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 908/1824] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:05.263538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.263538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.302317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 917/1825] 10.222.0.18 () {58 vars in 1046 bytes} [Sat Aug 21 12:27:05 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:05.303757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.307754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.340900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8358769-5aa2-4bdf-b56c-73fe74048418 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.351829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.352510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.352853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.353187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.371396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:05.394406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731ea33-c8a2-4349-8e03-28beaa093353 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.400785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.401641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.401768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.402149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.413732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:05.424210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.436476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 918/1826] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:05.436476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.446657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74291d7e-dbce-46d9-8cba-9b53f37b9acb service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.450613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.451277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.451618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.451953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.464553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:05.484684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.497800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.516763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 919/1827] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:05.521586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.524148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 909/1828] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:05.539309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af4e12-eb28-42ef-a751-b0349019bb71 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.548770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.549442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.549990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.550333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.557621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.691161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:05.716978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:05.741263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51886bb-064e-47ae-9f50-ec94348e0dc5 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:05.760195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:05.773333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:05.774522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:05.775085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:05.778515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547561b-eae0-4201-bea3-4a9434df28b8 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:05.785694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:05.808159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 920/1829] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:05.961070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:06.011471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6c3b-17a3-4029-aad4-2879adc26a67 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:06.024955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 910/1830] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:05 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:06.412668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7afe0-4fe1-4fbf-966c-37f441dae57c None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:06.413123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7afe0-4fe1-4fbf-966c-37f441dae57c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:06.413537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7afe0-4fe1-4fbf-966c-37f441dae57c None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:06.415640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 921/1831] 10.222.0.18 () {54 vars in 901 bytes} [Sat Aug 21 12:27:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:06.423153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451747b0-7657-47ad-818a-12d20627e00d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:06.423509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451747b0-7657-47ad-818a-12d20627e00d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:06.423847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451747b0-7657-47ad-818a-12d20627e00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:06.534576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-451747b0-7657-47ad-818a-12d20627e00d None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:06.538913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-451747b0-7657-47ad-818a-12d20627e00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:06.553643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 911/1832] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:27:06 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:06.592654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7afe0-4fe1-4fbf-966c-37f441dae57c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:06.615624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7afe0-4fe1-4fbf-966c-37f441dae57c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:06.625698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:06.627856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:06.628373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:06.628531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:06.648798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:06.707481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd21644-29b3-45cc-b3ea-c77de6f65075 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:06.721613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 922/1833] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:06 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:07.937510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:07.938016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:07.938171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:07.942024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 912/1834] 10.222.0.18 () {54 vars in 949 bytes} [Sat Aug 21 12:27:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:07.955361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:07.955707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:07.956040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:08.011035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] MFA Rules not processed for user `6eb3b883c2164df9b87386f1cecb0972`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:08.012486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:08.107488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:08.281490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:08.291933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 923/1835] 10.222.0.18 () {58 vars in 1047 bytes} [Sat Aug 21 12:27:07 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:08.292320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ddb56a-d611-4b9d-96b6-acb212c8a4d0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:08.292453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:08.292453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e89dd-9966-4f46-8b68-f11c4fdd28c2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:08.292689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:08.292689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:08.292689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:08.292689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] PATH_INFO: `/v3/projects/2d22a0436c7d4e3eb4e033d44e8bad56` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:08.293240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d22a0436c7d4e3eb4e033d44e8bad56)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:08.293366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:08.293366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:08.293366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:08.293366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:08.293924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:08.293924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:08.294184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:08.294311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:08.294311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 924/1836] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:08 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:08.377723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d22a0436c7d4e3eb4e033d44e8bad56', 'request_id': 'req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.388621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d22a0436c7d4e3eb4e033d44e8bad56', 'request_id': 'req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.448940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d22a0436c7d4e3eb4e033d44e8bad56', 'request_id': 'req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.479527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] The token cache is being invalidate because project 2d22a0436c7d4e3eb4e033d44e8bad56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:08.479869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.490391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.492380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 913/1837] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:08 2021] DELETE /identity/v3/projects/2d22a0436c7d4e3eb4e033d44e8bad56 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:08.497134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:08.518083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7500cb3-0c6d-4a5f-9cea-8866e118bd21 service placement] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:08.656442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:08.658630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:08.707810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:08.708765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:08.709110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:08.710075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] PATH_INFO: `/v3/users/5b28b5706e5642b49a531b3848bd9d10` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:08.712367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b28b5706e5642b49a531b3848bd9d10)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:08.777534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:08.879853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ac2e6-4b28-44da-ad96-e7620f6c7c5e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:08.890056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:08.890945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:08.891396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:08.891834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:08.900131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:08.930422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b28b5706e5642b49a531b3848bd9d10'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:08.936908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:08.957875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b28b5706e5642b49a531b3848bd9d10'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.032491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b28b5706e5642b49a531b3848bd9d10'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.033066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b28b5706e5642b49a531b3848bd9d10'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.049675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:09.074089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61493042-0242-4eac-9e08-afa3c6bad230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b28b5706e5642b49a531b3848bd9d10'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.096202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 914/1838] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:08 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:09.097492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:09.101558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:09.115047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 925/1839] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:08 2021] DELETE /identity/v3/users/5b28b5706e5642b49a531b3848bd9d10 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:09.133034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4df22e-0411-4001-8013-770cd427c784 service placement] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:09.338098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:09.342383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:09.342383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:09.342383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] PATH_INFO: `/v3/users/9dde5c55696947b881b9075938e3ee5e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:09.343652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dde5c55696947b881b9075938e3ee5e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:09.414032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:09.627591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dde5c55696947b881b9075938e3ee5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.653064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dde5c55696947b881b9075938e3ee5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.722239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dde5c55696947b881b9075938e3ee5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.723546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dde5c55696947b881b9075938e3ee5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.754509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dde5c55696947b881b9075938e3ee5e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:09.781915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 915/1840] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:09 2021] DELETE /identity/v3/users/9dde5c55696947b881b9075938e3ee5e => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:09.787673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:09.788268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:09.788858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:09.833469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:09.835138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:10.019260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 926/1841] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:10.071595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:10.073942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:10.292283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9e0a2-5e8c-4e81-acaf-c6c1164a4bd8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:10.301379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:10.310075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:10.310075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:10.310075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:10.333473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:10.393199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:10.421801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 916/1842] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:11.275936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:11.278661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:11.304432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea0527-54a3-4aeb-bb0b-5c2f33b7226a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:11.305143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:11.306574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:11.310770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:11.312228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:11.312528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:11.313011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] PATH_INFO: `/v3/projects/3f327caf86104a169744a8405d068600` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:11.314619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f327caf86104a169744a8405d068600)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:11.336567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd6f42-d985-4d1e-b8d4-c957a66423e0 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:11.354286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: WARNING py.warnings [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1007: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 12:27:11.354286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: warnings.warn(msg) Aug 21 12:27:11.354286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: Aug 21 12:27:11.355770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:11.364612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:11.366128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:11.366587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:11.367360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] PATH_INFO: `/v3/users/bc0bbb7ae29740728b4ac4d8c1b84c02` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:11.375683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0bbb7ae29740728b4ac4d8c1b84c02)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:11.437067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:11.467694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f327caf86104a169744a8405d068600', 'request_id': 'req-869bd24f-ed75-45f3-ac71-8b3c40808f8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.476279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f327caf86104a169744a8405d068600', 'request_id': 'req-869bd24f-ed75-45f3-ac71-8b3c40808f8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.512328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f327caf86104a169744a8405d068600', 'request_id': 'req-869bd24f-ed75-45f3-ac71-8b3c40808f8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.569909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] The token cache is being invalidate because project 3f327caf86104a169744a8405d068600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:11.570259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.571006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869bd24f-ed75-45f3-ac71-8b3c40808f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.572919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 927/1843] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:11 2021] DELETE /identity/v3/projects/3f327caf86104a169744a8405d068600 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:11.580379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd0d6-67df-450f-ad34-869dafe1a110 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:11.580720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd0d6-67df-450f-ad34-869dafe1a110 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:11.581057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dd0d6-67df-450f-ad34-869dafe1a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:11.615993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0bbb7ae29740728b4ac4d8c1b84c02'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.641993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0bbb7ae29740728b4ac4d8c1b84c02'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.649289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e90dd0d6-67df-450f-ad34-869dafe1a110 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:11.650568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e90dd0d6-67df-450f-ad34-869dafe1a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:11.702363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0bbb7ae29740728b4ac4d8c1b84c02'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.703055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0bbb7ae29740728b4ac4d8c1b84c02'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.736167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-12e3f187-6f6f-48c6-b7ec-f323fc071ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0bbb7ae29740728b4ac4d8c1b84c02'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:11.745223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 917/1844] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:11 2021] DELETE /identity/v3/users/bc0bbb7ae29740728b4ac4d8c1b84c02 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:11.750583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:11.763162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:11.765154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:11.815435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:11.818451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:11.834172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 928/1845] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:11.843946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:11.844246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:11.844687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:11.888132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:11.891045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:11.941995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 918/1846] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:11.998521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 929/1847] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:12.000104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.000810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.002391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:12.014099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa03b8-cbde-4e5b-9222-f0bd566b42ad None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.025489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.026452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.027085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.027560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.029181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:12.032122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.079459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.099561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 919/1848] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:27:12.104715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.119802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5ba4d-f31f-4cc5-bfe3-b431db92836d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.127044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.128585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.129410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.129812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.130552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.150165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10a02f-2bf4-4449-a367-0445eea240b2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.164044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.164834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.165245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.165648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.172178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.188106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.231777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.246591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 920/1849] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:12 2021] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:12.250296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.267898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 930/1850] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:12.376381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16148f03-6116-4a71-9150-728540d19264 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.386822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.387529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.388666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.388666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.388913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.464117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.523843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.526953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:12.536466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 921/1851] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:12 2021] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:27:12.541334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.562414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97c15a-7971-4b31-8570-866e255625d5 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.572554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061c40f-42ce-4a4c-a616-c92e0506be13 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.580177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.581273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.581613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.582832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] PATH_INFO: `/v3/projects/00a1dd6cf8684d8ca9a4c0ebf8005a50` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.586278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a1dd6cf8684d8ca9a4c0ebf8005a50)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.589305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.590157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.590691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.590998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.593348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.654413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.656616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.680178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 922/1852] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:12 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:12.684482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:12.713056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90dd91-0af9-46b9-8857-48cb79d4a36c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:12.727865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:12.728797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.729532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.729971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] PATH_INFO: `/v3/projects/bb7a1b77d6b64316b6ad6d4adc10a17c/users/fcd518c3a5b2429aaf1b0ac880b70960/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.775063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7a1b77d6b64316b6ad6d4adc10a17c, user_id=fcd518c3a5b2429aaf1b0ac880b70960, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:12.801621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a1dd6cf8684d8ca9a4c0ebf8005a50', 'request_id': 'req-ca821d07-cb3b-4317-8be8-6443526dc762'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:12.812439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4f3b8-e1d4-41f9-ac39-3231d897d3fd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:12.812893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a1dd6cf8684d8ca9a4c0ebf8005a50', 'request_id': 'req-ca821d07-cb3b-4317-8be8-6443526dc762'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:12.855782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 923/1853] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:12 2021] PUT /identity/v3/projects/bb7a1b77d6b64316b6ad6d4adc10a17c/users/fcd518c3a5b2429aaf1b0ac880b70960/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:12.866983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.867329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.867671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.877508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a1dd6cf8684d8ca9a4c0ebf8005a50', 'request_id': 'req-ca821d07-cb3b-4317-8be8-6443526dc762'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:12.908370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] The token cache is being invalidate because project 00a1dd6cf8684d8ca9a4c0ebf8005a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:12.908705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:12.910206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca821d07-cb3b-4317-8be8-6443526dc762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:12.915238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 931/1854] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:12 2021] DELETE /identity/v3/projects/00a1dd6cf8684d8ca9a4c0ebf8005a50 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:12.925292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:12.925638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:12.926020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:12.959290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] MFA Rules not processed for user `fcd518c3a5b2429aaf1b0ac880b70960`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:12.960462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:12.987186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:12.988454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:13.173521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 924/1855] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:12 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:13.174725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:13.176261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:13.205095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 932/1856] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:13.206123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:13.207893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:13.242645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e9ca2-8f56-4ee9-b212-e9c45e8653ed None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:13.248871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:13.249624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:13.249987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:13.250319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:13.251062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:13.305533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd68842-83c0-4df0-a0a2-0def41bd01c0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:13.379612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a53548-d763-4706-bf28-9bcb0ef9a5fc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:13.381077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 933/1857] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:13 2021] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:13.383978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:13.387684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:13.387684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:13.509038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:13.512889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:13.555970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:13.557297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:13.557747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:13.558319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] PATH_INFO: `/v3/projects/ff473fa5bc80441891d03f064db2b627` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:13.562170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff473fa5bc80441891d03f064db2b627)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:13.645763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:13.741747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 934/1858] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:13.742709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:13.754990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91cc35-7dd9-4d3e-9717-6cbec684d470 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:13.760396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:13.761307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:13.761847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:13.762351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:13.763405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:13.798401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:13.800227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff473fa5bc80441891d03f064db2b627', 'request_id': 'req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:13.806194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff473fa5bc80441891d03f064db2b627', 'request_id': 'req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:13.859159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 935/1859] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:13 2021] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:13.863055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:13.877342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c17f49-b32f-41bb-999c-4bc780ef4977 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:13.877780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff473fa5bc80441891d03f064db2b627', 'request_id': 'req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:13.913973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] The token cache is being invalidate because project ff473fa5bc80441891d03f064db2b627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:13.914402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:13.915189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:13.917493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 925/1860] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:13 2021] DELETE /identity/v3/projects/ff473fa5bc80441891d03f064db2b627 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:13.922130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:13.927095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:14.034489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:14.035632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:14.036575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:14.037082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:14.038154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:14.039063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:14.098883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:14.136655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48f8e3-97f4-41cf-95d1-56a84ff95e22 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:14.149906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:14.149906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:14.149906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:14.149906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:14.150213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 936/1861] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:27:14.150294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:14.150364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:14.154781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:14.183956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b523b1-519e-4808-bffb-17b0b74ce4a0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:14.195195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:14.196115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:14.196453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:14.196785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] PATH_INFO: `/v3/users/7489c32b27774f5d8900e50a6b815eef` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:14.199223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7489c32b27774f5d8900e50a6b815eef)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:14.203432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:14.233379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 926/1862] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:13 2021] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:14.239579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:14.241434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:14.267208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ca805-9783-45c6-a7cf-2bca1b76e379 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:14.274336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:14.284433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:14.285119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:14.285611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:14.285972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:14.286962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:14.379884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:14.479565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 927/1863] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:14 2021] POST /identity/v3/projects => generated 387 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:14.480474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:14.571054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7489c32b27774f5d8900e50a6b815eef'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:14.594239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7489c32b27774f5d8900e50a6b815eef'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:14.640256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7489c32b27774f5d8900e50a6b815eef'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:14.641011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7489c32b27774f5d8900e50a6b815eef'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:14.646536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca360e-e02f-4cd7-a463-28833b3bf85e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:14.663952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:14.664778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:14.665731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:14.665866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7489c32b27774f5d8900e50a6b815eef'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:14.665969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] PATH_INFO: `/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:14.683032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 937/1864] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:14 2021] DELETE /identity/v3/users/7489c32b27774f5d8900e50a6b815eef => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:14.684290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:14.688938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:14.714923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b05ce647d84b668bef6d3619ecaf94, user_id=594c70e91c8942348c4760d9fe02a232, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:14.773509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:14.835304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 928/1865] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:14 2021] PUT /identity/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:14.839463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:14.849101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:14.863470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d2d95-b634-4318-acb5-e80782143213 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.035774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.036668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.036997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.037333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.038096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.048463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2b04a-e36a-4747-9a4f-2dd0db699970 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.055478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.058910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.058910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.058910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.058910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.102256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.109241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.125295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 929/1866] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:14 2021] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:15.126493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:15.138738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343278c-2cca-4bb0-b20a-a31a87051821 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.165091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.166221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.166560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.166897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] PATH_INFO: `/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.172464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b05ce647d84b668bef6d3619ecaf94, user_id=594c70e91c8942348c4760d9fe02a232, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.204843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 938/1867] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:14 2021] POST /identity/v3/users => generated 294 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:15.209077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:15.232071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ec140-fb22-4285-a229-ce07d03c7c79 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.237242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.243074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.243779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.244122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.244448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.245216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.290607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 930/1868] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:15 2021] PUT /identity/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:15.300053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:15.306546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.343947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 939/1869] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:15 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:15.351413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:15.381336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a292914-5224-4a8f-8bf3-f22902e2e341 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.522532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ff14f-fe1d-43bb-85b4-ac5a5035124a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.556635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.557498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.557995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.558534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.560621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.600161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.601332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.601856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.602361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] PATH_INFO: `/v3/projects/e72797335aa34362a7e7572ca9e8fd28/users/dc26249060bd4daca3fa52c3cfb2c70a/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.637814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798e090e-5eac-4573-83dc-b0bb88159b33 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.658498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e72797335aa34362a7e7572ca9e8fd28, user_id=dc26249060bd4daca3fa52c3cfb2c70a, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:15.681096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 931/1870] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:15 2021] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:15.685358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88a46-69ba-4b5b-8028-b3f23e0369d1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.685705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88a46-69ba-4b5b-8028-b3f23e0369d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.686147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88a46-69ba-4b5b-8028-b3f23e0369d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.719693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:15.783973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 940/1871] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:15 2021] PUT /identity/v3/projects/e72797335aa34362a7e7572ca9e8fd28/users/dc26249060bd4daca3fa52c3cfb2c70a/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:15.793476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:15.853417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-77a88a46-69ba-4b5b-8028-b3f23e0369d1 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:15.854641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-77a88a46-69ba-4b5b-8028-b3f23e0369d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:15.950859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62edb8-08c9-4289-b197-4cd4e4190d6b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:15.961969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:15.962910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:15.963267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:15.963726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] PATH_INFO: `/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:15.968605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b05ce647d84b668bef6d3619ecaf94, user_id=594c70e91c8942348c4760d9fe02a232, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:16.035674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e10ade-faa6-4e35-b69b-89ae97013036 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:16.065367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 932/1872] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:27:15 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:16.066995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:16.067493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:16.067979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:16.109274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 941/1873] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:15 2021] PUT /identity/v3/projects/72b05ce647d84b668bef6d3619ecaf94/users/594c70e91c8942348c4760d9fe02a232/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:16.126428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e094e-0623-404e-9261-fad04523c718 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:16.126774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e094e-0623-404e-9261-fad04523c718 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:16.127041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] MFA Rules not processed for user `dc26249060bd4daca3fa52c3cfb2c70a`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:16.127158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e094e-0623-404e-9261-fad04523c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:16.128515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:16.212208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 933/1874] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:16 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:16.212464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-de9e094e-0623-404e-9261-fad04523c718 None None] MFA Rules not processed for user `594c70e91c8942348c4760d9fe02a232`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:16.213882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-de9e094e-0623-404e-9261-fad04523c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:16.216813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:16.337615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c754c70-3f11-42c4-a68e-cd92586c9478 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:16.342334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:16.343644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:16.343981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:16.344310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:16.345043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:16.374982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:16.437393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 942/1875] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:16 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:16.449583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e094e-0623-404e-9261-fad04523c718 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:16.451247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-de9e094e-0623-404e-9261-fad04523c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:16.455424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 934/1876] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:16 2021] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:16.460318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:16.585121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e094e-0623-404e-9261-fad04523c718 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:16.672774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f1dc9-dc84-4d13-850c-9eaa393cbaf5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:16.685069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:16.685769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:16.686796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:16.687129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:16.687863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:16.736598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:16.737282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:16.737630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:16.738024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:16.756015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:16.823849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 935/1877] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:16 2021] POST /identity/v3/users => generated 293 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:27:16.828836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:16.834738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:16.910020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:16.979502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:17.017771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 943/1878] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:16 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:17.020508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:17.042262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedffb-d9e9-4c5d-8d36-fd0d5d98392b service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:17.052385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:17.054298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c410c-cbf2-477b-8c4b-82c65d9f83be admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:17.055621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.055972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.056453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.057266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:17.070602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:17.071281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.071621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.072809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.105759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1993b4-61ee-4f1e-9828-9d430cb93872 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:17.118653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 944/1879] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:17 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:17.123463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.123990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.124816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.153327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:17.154336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:17.272481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:17.306866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 945/1880] 10.222.0.35 () {58 vars in 1006 bytes} [Sat Aug 21 12:27:17 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:17.307790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:17.332366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:17.343897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 936/1881] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:27:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:27:17.345335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ed38-987f-4a52-a893-0ce3dcac942f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:17.351223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:17.362470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd580b-18a4-42e1-b00d-379a7e2f02ca service swift] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:17.367066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:17.368249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.368700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.369148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.375134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:17.381466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:17.382436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.382783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.383109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] PATH_INFO: `/v3/projects/3d82ca70af924b0e90359658e30ee3ff/users/42d488a466a44ff9b5f99e5284f9e316/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.474826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d82ca70af924b0e90359658e30ee3ff, user_id=42d488a466a44ff9b5f99e5284f9e316, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:17.536901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:17.577013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:17.663142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 946/1882] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:17 2021] PUT /identity/v3/projects/3d82ca70af924b0e90359658e30ee3ff/users/42d488a466a44ff9b5f99e5284f9e316/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:17.668242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71782a11-42bf-41ee-a1b5-a803bca502fc service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:17.697482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:17.697643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 937/1883] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:17 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:17.700894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.701246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.701606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:17.706775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:17.851397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] MFA Rules not processed for user `42d488a466a44ff9b5f99e5284f9e316`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:17.852840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:17.960558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3da10-e792-4eca-a1ac-94b0c82c9287 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:17.973441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:17.974266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:17.974795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:17.975190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:18.009190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:18.026127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 938/1884] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:17 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:18.034376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:18.040411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:18.159091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:18.189320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 947/1885] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:17 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:18.190283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:18.343347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f2fc7-92d0-4241-b5fd-2bed61686db7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:18.370285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:18.371366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:18.371829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:18.372269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] PATH_INFO: `/v3/projects/9dde8ae6d0ba48efb18c77426437add9` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:18.377879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dde8ae6d0ba48efb18c77426437add9)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:18.524073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:18.607038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac429e5-8515-4784-ab49-70c85f2672cc service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:18.652609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:18.653368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:18.653708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:18.654122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:18.654911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:18.731399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:18.773197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dde8ae6d0ba48efb18c77426437add9', 'request_id': 'req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:18.787432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dde8ae6d0ba48efb18c77426437add9', 'request_id': 'req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:18.810023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 948/1886] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:18 2021] POST /identity/v3/projects => generated 387 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:18.811803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:18.857744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dde8ae6d0ba48efb18c77426437add9', 'request_id': 'req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:18.897408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] The token cache is being invalidate because project 9dde8ae6d0ba48efb18c77426437add9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:18.898095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:18.898981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ddde2bcc-0dc9-450b-92c3-a8f93599a70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:18.905321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 939/1887] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:18 2021] DELETE /identity/v3/projects/9dde8ae6d0ba48efb18c77426437add9 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:18.914877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f2c4-4ca4-4552-bc53-7457f4ddf855 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:18.916840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f2c4-4ca4-4552-bc53-7457f4ddf855 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:18.923927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f2c4-4ca4-4552-bc53-7457f4ddf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:18.959505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4655f2c4-4ca4-4552-bc53-7457f4ddf855 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:18.961112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4655f2c4-4ca4-4552-bc53-7457f4ddf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:19.044532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4499f-0a76-495f-b8f9-b6ca5e61f181 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:19.059384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:19.060097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.060445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.060788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.061582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:19.144144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 940/1888] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:19.155388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.158253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.158771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.163634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:19.215038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:19.216321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:19.233513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 941/1889] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:19.237721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.246718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 949/1890] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:18 2021] POST /identity/v3/users => generated 300 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:19.250402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85c8bc-c4a0-4074-bb87-7322bad9bc09 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:19.250852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.259422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:19.261305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:19.262944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.263483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.264004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.265458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:19.265909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:19.289655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b46ba0-2d3c-4950-bb43-ffd4f0964821 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:19.304159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:19.304884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.305261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.305584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.306391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:19.360626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:19.385004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:19.405641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 942/1891] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:27:19.407791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.408985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 950/1892] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:19 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:19.424297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.442640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df9041-298f-44a3-ad41-964b1cfe9742 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:19.449438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:19.450727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.451140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.451647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] PATH_INFO: `/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.452318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071427e-17a8-4772-ad0a-f0e1752ac46e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:19.474563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:19.475255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:19.475596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:19.475927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:19.476677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:19.493943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3771c03176a424882f1b59df0034bcf, user_id=5d722aa5fcc14d29b296cd0a0f69d69c, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:19.544567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:19.593861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:19.594424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 951/1893] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:19 2021] PUT /identity/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:19.599007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.709846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 943/1894] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:19 2021] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:19.722654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:19.929049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d459e2f-baff-485c-bee3-461e37d64b2b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.094488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca962c1-973c-4e42-a60b-ad0595b9dfab admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.121425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.122412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.122761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.124097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.136570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:20.240872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:20.277544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.278186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.278531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.278866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.282128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:20.327560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:20.339789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 952/1895] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:19 2021] GET /identity/v3/roles => generated 1420 bytes in 741 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:20.344882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:20.370763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 944/1896] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:19 2021] POST /identity/v3/users => generated 294 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:20.372431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:20.404408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867020e0-2aea-4537-b4cd-aee8571253a2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.419382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e556a-578c-42ef-af61-3174dbdf95f8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.433319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.434118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.434467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.434855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.435664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:20.436858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.437814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.438531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.438531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] PATH_INFO: `/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.445890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3771c03176a424882f1b59df0034bcf, user_id=5d722aa5fcc14d29b296cd0a0f69d69c, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:20.513763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:20.537252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 945/1897] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:20.541172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:20.553273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:20.574628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fdc13-6ba8-474d-be51-b1d10b34beae admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.580700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 953/1898] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:20 2021] PUT /identity/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:20.584832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:20.834001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.843631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.844620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.845977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] PATH_INFO: `/v3/projects/dd2c4e1de2d74d8597eb2128b9753a4b/users/47722a914c09492eba9b35feee6af5d4/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.903971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810e672-e9a1-4be8-bd3d-ab0f9a362713 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:20.914239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:20.914952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:20.915306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:20.915788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:20.916421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:20.951988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2c4e1de2d74d8597eb2128b9753a4b, user_id=47722a914c09492eba9b35feee6af5d4, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:21.043979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:21.077704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98998cb-8ca5-46da-bf3b-78cceda116d0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:21.118416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 954/1899] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:21.119833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da3f6-3de8-4171-a29a-59a348dda6dc None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:21.120185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da3f6-3de8-4171-a29a-59a348dda6dc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:21.120519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da3f6-3de8-4171-a29a-59a348dda6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:21.120724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 946/1900] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:20 2021] PUT /identity/v3/projects/dd2c4e1de2d74d8597eb2128b9753a4b/users/47722a914c09492eba9b35feee6af5d4/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:21.134111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:21.275976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-de0da3f6-3de8-4171-a29a-59a348dda6dc None None] MFA Rules not processed for user `8b6165455d13434895121c88ea45e312`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:21.277516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-de0da3f6-3de8-4171-a29a-59a348dda6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:21.345370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35478e-8ef0-495d-bcc2-c4ad56c9cb9b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:21.366667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:21.367843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:21.368288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:21.369047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] PATH_INFO: `/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:21.376428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3771c03176a424882f1b59df0034bcf, user_id=5d722aa5fcc14d29b296cd0a0f69d69c, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:21.451020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 955/1901] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:21 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:21.458010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2110f-5030-4157-8a8d-fd92a398475a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:21.458737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2110f-5030-4157-8a8d-fd92a398475a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:21.459265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2110f-5030-4157-8a8d-fd92a398475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:21.476631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2194ce-208a-4d4a-95b5-f3dae96a71ec admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:21.545644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 947/1902] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:21 2021] PUT /identity/v3/projects/e3771c03176a424882f1b59df0034bcf/users/5d722aa5fcc14d29b296cd0a0f69d69c/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:21.555328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:21.555328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:21.555328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:21.555328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 948/1903] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:27:21 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:21.556429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:21.563387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:21.790851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad6f1a-7313-44ed-8d8f-37094b223308 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:21.802481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:21.803116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:21.803463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:21.803796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:21.877231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9df2110f-5030-4157-8a8d-fd92a398475a None None] MFA Rules not processed for user `47722a914c09492eba9b35feee6af5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:21.878958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9df2110f-5030-4157-8a8d-fd92a398475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:22.051860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:22.185834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb5345-f876-41c2-b23d-cc42371e7e2e service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:22.205725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 956/1904] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:21 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 754 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:22.211840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:22.212957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:22.218421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:22.232692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 949/1905] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:21 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:22.234823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:22.235329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:22.235820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:22.305770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:22.307356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:22.330648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 950/1906] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:27:22 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:22.331388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:22.347046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] MFA Rules not processed for user `5d722aa5fcc14d29b296cd0a0f69d69c`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:22.351723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:22.540130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521e797-6b26-4eb6-9f57-5cca2df4174d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:22.552898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:22.553601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:22.559117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:22.559536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:22.560272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:22.643299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:22.659427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 957/1907] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:22 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:22.747195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 951/1908] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:22 2021] POST /identity/v3/projects => generated 385 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:22.749498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:22.783249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d230f11-e8c3-4f3c-9041-33303843991d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:22.851164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:22.856997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:23.027346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:23.028048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:23.028394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:23.028732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:23.029486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:23.054986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353172a-0be0-400a-bb97-a35629b9aa91 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:23.065401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:23.066112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:23.066458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:23.066791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:23.143588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:23.254953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:23.281302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 958/1909] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:22 2021] POST /identity/v3/users => generated 299 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:23.285388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:23.332468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae8e6-9d18-4abe-9b21-e79eaf160eca admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:23.346358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:23.348743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:23.349444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:23.349817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:23.350153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:23.354686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:23.390374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 952/1910] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:22 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:23.514689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:23.548674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 959/1911] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:23.553736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:23.571482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50945ae-c1a9-4820-93e1-e4ef42325fcf service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:23.589711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:23.590789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:23.591215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:23.592474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] PATH_INFO: `/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:23.618106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:23.679553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b821e9d0cc94c58a15843c2709a5fa3, user_id=9f14d1610e894d9b9d1ac5a2b25d6049, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:23.785664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:23.851176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 953/1912] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:23 2021] PUT /identity/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:23.858912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:23.927396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60001-a4e8-48d5-9b9f-4323caec4e5e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:24.026122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3345bf8-703c-4cbc-967a-277a7dd73fd2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:24.042168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:24.042956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.043368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.043788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.044778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:24.136080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:24.167572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 954/1913] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:23 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:24.168714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:24.169844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:24.170585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.170921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.171258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.189942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:24.200329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e96aa-237c-42f6-b88e-01fd68b4771b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:24.205255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:24.206232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.206576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.206903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] PATH_INFO: `/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.219473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b821e9d0cc94c58a15843c2709a5fa3, user_id=9f14d1610e894d9b9d1ac5a2b25d6049, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:24.275378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:24.285771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:24.299750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 955/1914] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:24 2021] PUT /identity/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:24.304585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:24.306362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 960/1915] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:23 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:24.468595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a511c81-9258-4fa9-8b80-2ad57252d3b4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:24.474126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:24.474759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.475107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.475504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.476762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:24.525371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f7968-ff69-4bd6-89b6-8b36336b615a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:24.585529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 956/1916] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:24.590567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:24.610966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66be62-08a2-484e-b334-42aa86225c5b service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:24.630029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:24.634402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.634402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.634402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] PATH_INFO: `/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.637334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b821e9d0cc94c58a15843c2709a5fa3, user_id=9f14d1610e894d9b9d1ac5a2b25d6049, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:24.707614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:24.771244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 961/1917] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:24 2021] PUT /identity/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3/users/9f14d1610e894d9b9d1ac5a2b25d6049/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:24.783159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:24.783524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:24.783909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:24.924542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] MFA Rules not processed for user `9f14d1610e894d9b9d1ac5a2b25d6049`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:24.925804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:25.145057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 957/1918] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:24 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:25.288914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:25.409029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d6951-a90a-4327-a11f-8ca18502d962 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:25.417070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:25.419252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:25.422635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:25.423190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:25.442836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:25.504103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:25.521242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 962/1919] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:25 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:25.590094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:25.812236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d899-e47d-48f6-95d3-3fc93758a784 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:25.829114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:25.832001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:25.832001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:25.832001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] PATH_INFO: `/v3/users/47722a914c09492eba9b35feee6af5d4` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:25.833201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47722a914c09492eba9b35feee6af5d4)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:25.909042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:26.101395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47722a914c09492eba9b35feee6af5d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:26.113716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47722a914c09492eba9b35feee6af5d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:26.126286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:26.148917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651a27-c8ff-4345-976f-44073e12ea37 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:26.149251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47722a914c09492eba9b35feee6af5d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:26.150490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47722a914c09492eba9b35feee6af5d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:26.174651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:26.175343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:26.175661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:26.176157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:26.178473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:26.187165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c483fa7-9641-4877-a81c-002ed96338b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47722a914c09492eba9b35feee6af5d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:26.213687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 958/1920] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:25 2021] DELETE /identity/v3/users/47722a914c09492eba9b35feee6af5d4 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:26.225902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:26.226316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:26.227334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:26.347568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:26.348827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:26.455326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:26.524716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 959/1921] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:26.524950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166b894-efcb-47f3-b035-d8b97bc7263a service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:26.551877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 963/1922] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:26 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:26.846091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:26.847514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:27.004489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fd091-b8e2-4b95-9053-d8b83078f1ad None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:27.015212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:27.016124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:27.016730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:27.017381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:27.040294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:27.113482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0f87e-ba26-4c68-99a6-fd03676a1544 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:27.140612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 960/1923] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:28.628409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:28.628409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:28.628409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:28.769397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] MFA Rules not processed for user `6e43e097c35646c4a7cd85d247b9d398`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:28.771268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:28.971882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 964/1924] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:28 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:28.983124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436629fe-a69a-49f4-a8cf-4b6866d392a8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:28.983476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436629fe-a69a-49f4-a8cf-4b6866d392a8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:28.983817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436629fe-a69a-49f4-a8cf-4b6866d392a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:29.043645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-436629fe-a69a-49f4-a8cf-4b6866d392a8 None None] MFA Rules not processed for user `6e43e097c35646c4a7cd85d247b9d398`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:29.049755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-436629fe-a69a-49f4-a8cf-4b6866d392a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:29.070849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 961/1925] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:28 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:29.082646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:29.084735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:29.405183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cd4da-5031-493c-a9d9-78a4c20ce01b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:29.420571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:29.421449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:29.421850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:29.422165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:29.438919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:29.509287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:29.509688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:29.512699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:29.554831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:29.580468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 965/1926] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:29 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:29.696162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] MFA Rules not processed for user `69507673906f416b8ef8befb0e240329`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:29.696162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:29.932636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 962/1927] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:29 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:30.634986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:30.636571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:30.663693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa27c-d17c-4389-8f55-c7c37f91e9d5 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:30.681553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:30.683810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:30.684297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:30.688514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:30.691235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:30.691593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] PATH_INFO: `/v3/projects/dd2c4e1de2d74d8597eb2128b9753a4b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:30.698072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2c4e1de2d74d8597eb2128b9753a4b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:30.703059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca02ab4-9227-4910-bbd8-0acb7243eb29 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:30.708932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:30.709773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:30.710291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:30.711337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:30.722714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:30.775183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:30.788975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:30.804407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 963/1928] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:30 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:30.963106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2c4e1de2d74d8597eb2128b9753a4b', 'request_id': 'req-fd7f492e-49b8-416f-8981-83eeafafd0cf'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:30.979236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2c4e1de2d74d8597eb2128b9753a4b', 'request_id': 'req-fd7f492e-49b8-416f-8981-83eeafafd0cf'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.032948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2c4e1de2d74d8597eb2128b9753a4b', 'request_id': 'req-fd7f492e-49b8-416f-8981-83eeafafd0cf'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.091261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] The token cache is being invalidate because project dd2c4e1de2d74d8597eb2128b9753a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:31.091601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.093967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.100059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 966/1929] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:30 2021] DELETE /identity/v3/projects/dd2c4e1de2d74d8597eb2128b9753a4b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:31.102130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:31.121345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ef6c2-4bca-4566-bb50-d6df66055b62 service nova] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:31.236014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:31.237163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:31.237757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:31.239394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] PATH_INFO: `/v3/users/9f14d1610e894d9b9d1ac5a2b25d6049` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:31.241066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f14d1610e894d9b9d1ac5a2b25d6049)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:31.278148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:31.481471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f14d1610e894d9b9d1ac5a2b25d6049'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.547154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f14d1610e894d9b9d1ac5a2b25d6049'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.590035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f14d1610e894d9b9d1ac5a2b25d6049'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.594045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f14d1610e894d9b9d1ac5a2b25d6049'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.641056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f14d1610e894d9b9d1ac5a2b25d6049'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:31.666573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 964/1930] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:31 2021] DELETE /identity/v3/users/9f14d1610e894d9b9d1ac5a2b25d6049 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:33.452092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:33.455911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:33.481108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f492e-49b8-416f-8981-83eeafafd0cf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:33.696794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:33.697704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:33.700186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:33.700186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] PATH_INFO: `/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:33.714755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b821e9d0cc94c58a15843c2709a5fa3)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:33.765175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:33.952806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:33.954862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.048895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b821e9d0cc94c58a15843c2709a5fa3', 'request_id': 'req-b959d3b3-a68b-485a-8c6c-ad81686317ac'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:34.126987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a872c1-f2bd-433c-bfa3-4c2d36e6403b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:34.132603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b821e9d0cc94c58a15843c2709a5fa3', 'request_id': 'req-b959d3b3-a68b-485a-8c6c-ad81686317ac'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:34.211312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b821e9d0cc94c58a15843c2709a5fa3', 'request_id': 'req-b959d3b3-a68b-485a-8c6c-ad81686317ac'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:34.276931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:34.277613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:34.278045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:34.278322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:34.296600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] The token cache is being invalidate because project 3b821e9d0cc94c58a15843c2709a5fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:34.297097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:34.297573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.298126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b959d3b3-a68b-485a-8c6c-ad81686317ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:34.300357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 967/1931] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:33 2021] DELETE /identity/v3/projects/3b821e9d0cc94c58a15843c2709a5fa3 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:34.302142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa137-31e9-4d9c-a6f3-4e2f0fe5cc91 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:34.302693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa137-31e9-4d9c-a6f3-4e2f0fe5cc91 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:34.303221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59faa137-31e9-4d9c-a6f3-4e2f0fe5cc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:34.377934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-59faa137-31e9-4d9c-a6f3-4e2f0fe5cc91 None None] MFA Rules not processed for user `6e43e097c35646c4a7cd85d247b9d398`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:34.387137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-59faa137-31e9-4d9c-a6f3-4e2f0fe5cc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.510020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:34.552783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:34.561924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 968/1932] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:34 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:34.565135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429eefd-f82f-4a5f-8613-ed3eecc38724 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:34.565750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429eefd-f82f-4a5f-8613-ed3eecc38724 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:34.566250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429eefd-f82f-4a5f-8613-ed3eecc38724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:34.593863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 965/1933] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:33 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:34.599200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3429eefd-f82f-4a5f-8613-ed3eecc38724 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:34.600723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3429eefd-f82f-4a5f-8613-ed3eecc38724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.753471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:34.755597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.770897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 969/1934] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:34.778972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:34.780034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:34.780532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:34.867125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:34.876247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:34.909883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 970/1935] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:34.916598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:34.940178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab702d-b0ce-4aec-96b7-51adf7557c40 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:34.969390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:34.973800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:34.975104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:34.975448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:34.976265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:34.976627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:35.061678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9418a8-0309-4641-8cde-507084b267ee service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:35.069705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:35.100040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:35.100968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.101305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.101639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] PATH_INFO: `/v3/users/fcd518c3a5b2429aaf1b0ac880b70960` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.113823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd518c3a5b2429aaf1b0ac880b70960)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:35.120532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 971/1936] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:27:35.126782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:35.149966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b648-af1f-4c38-9844-7ac23dd6dbd4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:35.156836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:35.157522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.160527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.161171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.162569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:35.217293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:35.267234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:35.450602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 972/1937] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:35 2021] POST /identity/v3/projects => generated 409 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:35.450602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:35.512051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd518c3a5b2429aaf1b0ac880b70960'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:35.540774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd518c3a5b2429aaf1b0ac880b70960'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:35.610413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd518c3a5b2429aaf1b0ac880b70960'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:35.616629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd518c3a5b2429aaf1b0ac880b70960'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:35.633105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7302c-72d1-4e6a-adb6-5368ded0ed54 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:35.639940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:35.640773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.641263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.641719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.642610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:35.652300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ef81ba08-b19d-4099-9391-2f67c61c6aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd518c3a5b2429aaf1b0ac880b70960'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:35.682437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 966/1938] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:34 2021] DELETE /identity/v3/users/fcd518c3a5b2429aaf1b0ac880b70960 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:35.682437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.682437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.682437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.695535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc41dc-f6d3-408f-8f1d-ec0e7b1703a4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:35.757208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] MFA Rules not processed for user `8b6165455d13434895121c88ea45e312`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:35.766239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 973/1939] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:35 2021] POST /identity/v3/users => generated 305 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:35.767663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef83236-7e17-42f9-9f82-963ce721b6ee None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.768006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef83236-7e17-42f9-9f82-963ce721b6ee None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.768340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef83236-7e17-42f9-9f82-963ce721b6ee None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.770484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:35.774362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 974/1940] 10.222.0.18 () {54 vars in 901 bytes} [Sat Aug 21 12:27:35 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:35.781388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821599da-96f3-4f31-8f19-34d3b6337f12 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:35.782093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821599da-96f3-4f31-8f19-34d3b6337f12 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:35.782493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821599da-96f3-4f31-8f19-34d3b6337f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:35.829010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-821599da-96f3-4f31-8f19-34d3b6337f12 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:35.830366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-821599da-96f3-4f31-8f19-34d3b6337f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:35.909832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 967/1941] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:35 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:35.909832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:35.926250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:36.010624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 975/1942] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:36.013989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.014347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.014687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.116266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:36.129281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:36.140035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0fd3b-d56c-441d-a00f-d05066211ede None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:36.179391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:36.180122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.180464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.180797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.187082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:36.279561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:36.281099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 976/1943] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:27:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:36.290263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:36.292610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:36.300409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 968/1944] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:35 2021] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:36.304918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:36.308955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139aee32-e21d-439a-baca-50b185bb3f21 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:36.314280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:36.316086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.316557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.317002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.332487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:36.337076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7a7f8-af65-4308-8be0-48d4645165c8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:36.361696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:36.362441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.362789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.363127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.367303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:36.372483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:36.384469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 977/1945] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:36.385824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:36.400443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce38e-784c-491d-8d55-3e54131030d5 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:36.406872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:36.407971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.409049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.409538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] PATH_INFO: `/v3/projects/43291870e0254dd8aae778f37631af5d/users/d4bd106ff9ab4d80bec18bda15508b44/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.446757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43291870e0254dd8aae778f37631af5d, user_id=d4bd106ff9ab4d80bec18bda15508b44, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:36.456809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe5df3-8c06-405c-8209-0a6634ad6a6e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:36.480307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 969/1946] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:36 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:36.559916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:36.618865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 978/1947] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:36 2021] PUT /identity/v3/projects/43291870e0254dd8aae778f37631af5d/users/d4bd106ff9ab4d80bec18bda15508b44/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:36.629730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:36.630111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:36.630447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:36.723175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] MFA Rules not processed for user `d4bd106ff9ab4d80bec18bda15508b44`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:36.725003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:36.987894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 970/1948] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:36 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:36.992284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:37.163015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729bacea-1a0e-40e4-8084-f2a7ddf4940c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:37.182129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:37.185286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:37.185286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:37.185286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:37.185286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:37.218239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:37.364708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 979/1949] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:36 2021] POST /identity/v3/projects => generated 409 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:37.368995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:37.390118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494915a-32d8-43d0-ab78-1f71cb5cc98d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:37.567966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:37.568786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:37.569133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:37.569469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:37.572595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:37.661163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:37.789030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 971/1950] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:37 2021] POST /identity/v3/users => generated 311 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:37.794820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:37.807241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5ea39-cec8-458c-af69-9a34c9d2a28d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:37.814540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:37.818259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:37.818259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:37.818259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:37.818259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:37.858059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:37.881813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 980/1951] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:37 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:37.883137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:37.894919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f557-1963-4a5a-a628-b761a41579fa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:37.900217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:37.901429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:37.905365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:37.905932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] PATH_INFO: `/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:37.930277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbaf6b5ee44ced8b57d9ffddb500bf, user_id=79dacc9edff64aa597e308d3a9166085, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:38.027806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac438a-7a7f-4c75-9404-4a8293f97d83 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:38.073135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 972/1952] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:37 2021] PUT /identity/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:38.077703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.090529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5037d-b2a8-4889-ae59-0db7d8463305 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:38.154936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa29d-4638-44f3-8d73-d5f527494ec8 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.155071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa29d-4638-44f3-8d73-d5f527494ec8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.155570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa29d-4638-44f3-8d73-d5f527494ec8 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.163280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 973/1953] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:27:38 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:38.174940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732585f5-5f0e-42bf-9a94-f87de6242f2d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.175383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732585f5-5f0e-42bf-9a94-f87de6242f2d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.176231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732585f5-5f0e-42bf-9a94-f87de6242f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.240577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-732585f5-5f0e-42bf-9a94-f87de6242f2d None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:38.242187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-732585f5-5f0e-42bf-9a94-f87de6242f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:38.342421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:38.343128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.343863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.344206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.346644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:38.384488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:38.398831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 981/1954] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:38.407094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.436292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dfd95-318a-4a6d-8380-41072b2f772b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:38.449687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:38.451658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.452076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.452318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] PATH_INFO: `/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.454955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbaf6b5ee44ced8b57d9ffddb500bf, user_id=79dacc9edff64aa597e308d3a9166085, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:38.490491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:38.504522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 982/1955] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:38 2021] PUT /identity/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:38.508728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.553678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 974/1956] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:27:38 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:38.555921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.556481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.557929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.600954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0032bcc-fa8b-4846-8bfa-2239c6d32d11 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:38.607413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:38.608323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.608838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.609340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.610396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:38.643719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] MFA Rules not processed for user `69507673906f416b8ef8befb0e240329`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:38.646325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:38.650185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:38.665392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 983/1957] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:38 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:38.669541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.672865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:38.746824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 975/1958] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:38 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:38.753858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.763511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b9dd-de52-4b04-ba29-829b160422ca None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:38.769824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:38.770883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:38.771333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:38.771773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] PATH_INFO: `/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:38.788377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbaf6b5ee44ced8b57d9ffddb500bf, user_id=79dacc9edff64aa597e308d3a9166085, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:38.830487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:38.880044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5dd7-a555-4633-b807-8d04f97ccdc7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:38.884553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 976/1959] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:38 2021] PUT /identity/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf/users/79dacc9edff64aa597e308d3a9166085/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:38.885754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:38.890573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:39.085175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:39.086105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:39.086600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:39.087099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:39.098589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:39.115158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540f160-bae8-4db6-b7e8-f526c560c969 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:39.120566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:39.121570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:39.122161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:39.122987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] PATH_INFO: `/v3/projects/bb7a1b77d6b64316b6ad6d4adc10a17c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:39.124500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7a1b77d6b64316b6ad6d4adc10a17c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:39.168243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:39.169404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b51d9b-2fb1-4f20-b362-3454f0b237c1 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:39.188179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 984/1960] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:38 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:39.189568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:39.189942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:39.190389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:39.253891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] MFA Rules not processed for user `79dacc9edff64aa597e308d3a9166085`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:39.255168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:39.417268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 985/1961] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:39 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:39.547604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7a1b77d6b64316b6ad6d4adc10a17c', 'request_id': 'req-ea437b44-12fd-4c4f-aff1-61b43e857e72'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:39.547604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7a1b77d6b64316b6ad6d4adc10a17c', 'request_id': 'req-ea437b44-12fd-4c4f-aff1-61b43e857e72'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:39.632709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:39.632709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:39.644690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7a1b77d6b64316b6ad6d4adc10a17c', 'request_id': 'req-ea437b44-12fd-4c4f-aff1-61b43e857e72'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:39.695537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] The token cache is being invalidate because project bb7a1b77d6b64316b6ad6d4adc10a17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:39.698894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:39.700185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:39.703544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 977/1962] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:38 2021] DELETE /identity/v3/projects/bb7a1b77d6b64316b6ad6d4adc10a17c => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:39.707976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:39.712207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:39.718639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcbe3d-5d12-43b5-956e-bc285da2968d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:39.858702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:39.859509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:39.862137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:39.862491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:39.866266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:39.892419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea437b44-12fd-4c4f-aff1-61b43e857e72 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:39.908205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:39.908793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:39.909250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:39.911120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] PATH_INFO: `/v3/users/594c70e91c8942348c4760d9fe02a232` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:39.912964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] RBAC: Authorizing `identity:delete_user(user_id=594c70e91c8942348c4760d9fe02a232)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:39.965568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:40.074332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:40.104632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:40.115895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 986/1963] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:39 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:40.141182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594c70e91c8942348c4760d9fe02a232'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:40.157060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594c70e91c8942348c4760d9fe02a232'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:40.205200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594c70e91c8942348c4760d9fe02a232'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:40.206092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594c70e91c8942348c4760d9fe02a232'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:40.222338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594c70e91c8942348c4760d9fe02a232'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:40.230570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 978/1964] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:39 2021] DELETE /identity/v3/users/594c70e91c8942348c4760d9fe02a232 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:40.841171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:40.843269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:40.856547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731368c-bce4-42ef-adc0-dcc0f7a3bbb1 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:40.982896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:40.984830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:41.008737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:41.009576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:41.010914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:41.011382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:41.017996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:41.095427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb585-90ff-40e4-bea2-f4d16f6f153b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:41.101604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:41.103497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:41.104131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:41.104580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] PATH_INFO: `/v3/users/dc26249060bd4daca3fa52c3cfb2c70a` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:41.106337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc26249060bd4daca3fa52c3cfb2c70a)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:41.139898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:41.144808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:41.173404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033dc87-1b9c-4841-8045-3879aaa55987 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:41.195045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 987/1965] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:40 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:41.363055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc26249060bd4daca3fa52c3cfb2c70a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:41.373403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc26249060bd4daca3fa52c3cfb2c70a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:41.405334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc26249060bd4daca3fa52c3cfb2c70a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:41.406229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc26249060bd4daca3fa52c3cfb2c70a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:41.423341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc26249060bd4daca3fa52c3cfb2c70a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:41.440221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 979/1966] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:40 2021] DELETE /identity/v3/users/dc26249060bd4daca3fa52c3cfb2c70a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:41.444739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:41.445086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:41.445418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:41.472802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:41.474099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:41.545228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 988/1967] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:41.557024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:41.558549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:41.633190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece84b4-c0fb-4694-9b36-b707644b546d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:41.637158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:41.637860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:41.638206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:41.639059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:41.649032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:41.678092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:41.689393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 980/1968] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:42.439012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:42.441510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:42.457128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186fe25-a2ca-4993-b5af-741cdda061ed None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:42.462966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:42.464898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:42.465578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:42.466098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] PATH_INFO: `/v3/projects/72b05ce647d84b668bef6d3619ecaf94` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:42.470793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b05ce647d84b668bef6d3619ecaf94)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:42.506019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:42.629146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b05ce647d84b668bef6d3619ecaf94', 'request_id': 'req-62318aa0-61fa-481c-8d1c-922f4431ee98'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.647152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b05ce647d84b668bef6d3619ecaf94', 'request_id': 'req-62318aa0-61fa-481c-8d1c-922f4431ee98'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.654225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:42.654225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:42.665499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696ce47-140a-4013-81ac-eabb076074ba service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:42.701854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b05ce647d84b668bef6d3619ecaf94', 'request_id': 'req-62318aa0-61fa-481c-8d1c-922f4431ee98'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.726396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] The token cache is being invalidate because project 72b05ce647d84b668bef6d3619ecaf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:42.726956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.735251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-62318aa0-61fa-481c-8d1c-922f4431ee98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.742384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 989/1969] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:42 2021] DELETE /identity/v3/projects/72b05ce647d84b668bef6d3619ecaf94 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:42.755740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d46d-96d8-46ec-9753-3aa66e6db354 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:42.756084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d46d-96d8-46ec-9753-3aa66e6db354 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:42.756674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5d46d-96d8-46ec-9753-3aa66e6db354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:42.773683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:42.779537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:42.779896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:42.780280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] PATH_INFO: `/v3/projects/e72797335aa34362a7e7572ca9e8fd28` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:42.781592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e72797335aa34362a7e7572ca9e8fd28)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:42.790408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-75d5d46d-96d8-46ec-9753-3aa66e6db354 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:42.794189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-75d5d46d-96d8-46ec-9753-3aa66e6db354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:42.800969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 990/1970] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:42.809666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:42.810056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:42.810420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:42.811419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:42.837164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:42.838374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:42.848542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 991/1971] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:42.855330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:42.863242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323db4eb-7b5e-4e16-90ae-f69070778676 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:42.867804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:42.868458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:42.868791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:42.869117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:42.869936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:42.870282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:42.900635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:42.920415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 992/1972] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:27:42.925452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:42.935357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e72797335aa34362a7e7572ca9e8fd28', 'request_id': 'req-36f4986a-7e22-4002-9f34-4c7d2756e2bd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.937691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddfb27-87da-476b-b4ae-5ae7c2681d08 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:42.951795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e72797335aa34362a7e7572ca9e8fd28', 'request_id': 'req-36f4986a-7e22-4002-9f34-4c7d2756e2bd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:42.987219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e72797335aa34362a7e7572ca9e8fd28', 'request_id': 'req-36f4986a-7e22-4002-9f34-4c7d2756e2bd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.019974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.020655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.020992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.021321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.022187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.029756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] The token cache is being invalidate because project e72797335aa34362a7e7572ca9e8fd28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:43.030127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.031469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.036145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 981/1973] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:42 2021] DELETE /identity/v3/projects/e72797335aa34362a7e7572ca9e8fd28 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:43.037222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.038617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:43.052517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4986a-7e22-4002-9f34-4c7d2756e2bd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.057121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.058637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.062035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.062035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.062035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] PATH_INFO: `/v3/users/42d488a466a44ff9b5f99e5284f9e316` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.062035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d488a466a44ff9b5f99e5284f9e316)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.097677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.121104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 993/1974] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:42 2021] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:43.125136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.126859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:43.205082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d488a466a44ff9b5f99e5284f9e316'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.209323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ec58e-047e-480d-903d-fbe907414b50 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.215298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.215987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.216586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.216926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.217609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d488a466a44ff9b5f99e5284f9e316'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.218354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.250847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.256259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d488a466a44ff9b5f99e5284f9e316'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.257175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d488a466a44ff9b5f99e5284f9e316'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.273249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d488a466a44ff9b5f99e5284f9e316'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:43.280179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 982/1975] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:43 2021] DELETE /identity/v3/users/42d488a466a44ff9b5f99e5284f9e316 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:43.297617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 994/1976] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:43 2021] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:27:43.304201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.306298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:43.399063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c2c-7c57-4bc7-88f3-699ca021446d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.403761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.404478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.404820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.405155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.406005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.435739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf559d-7d47-4280-be09-ab5a17d90e15 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.446881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 983/1977] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:43 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:43.451525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.462240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95476839-b16f-4fcc-8a96-a95c91f45f0d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.466938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.467851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.468195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.468531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] PATH_INFO: `/v3/projects/0b6d4c83e87b4591af5db9a32f6daa23/users/23eb7cd820394fc0ba4590d0a5f5853b/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.492152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6d4c83e87b4591af5db9a32f6daa23, user_id=23eb7cd820394fc0ba4590d0a5f5853b, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.522639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.559530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 995/1978] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:43 2021] PUT /identity/v3/projects/0b6d4c83e87b4591af5db9a32f6daa23/users/23eb7cd820394fc0ba4590d0a5f5853b/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:43.570397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.570759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.571102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.612717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] MFA Rules not processed for user `23eb7cd820394fc0ba4590d0a5f5853b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:43.613936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:43.695346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 984/1979] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:43 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:27:43.700266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.806218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313879a-bab7-4f45-96ee-d9b8c2d270db admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.811642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.816248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.816248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.816248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.816248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.849523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:43.850191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:43.855563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.888685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cbc30-f4f8-4e62-9a64-abe6c4288b44 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:43.898474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:43.899611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:43.910267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:43.910267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] PATH_INFO: `/v3/projects/3d82ca70af924b0e90359658e30ee3ff` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:43.910267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d82ca70af924b0e90359658e30ee3ff)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:43.934746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:43.964788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 996/1980] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:43 2021] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:43.969084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.082434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d82ca70af924b0e90359658e30ee3ff', 'request_id': 'req-71bb2556-007e-41e6-9b77-fbc155470f5a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.090382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cbc2d-fb3c-47b7-a7a2-5f8947046eaf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.098389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d82ca70af924b0e90359658e30ee3ff', 'request_id': 'req-71bb2556-007e-41e6-9b77-fbc155470f5a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.134726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d82ca70af924b0e90359658e30ee3ff', 'request_id': 'req-71bb2556-007e-41e6-9b77-fbc155470f5a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.179678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] The token cache is being invalidate because project 3d82ca70af924b0e90359658e30ee3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:44.182019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.184130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.186557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 985/1981] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:43 2021] DELETE /identity/v3/projects/3d82ca70af924b0e90359658e30ee3ff => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:44.191046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.192623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:44.226618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.228300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.228870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.229345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.230631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.284675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.303783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2556-007e-41e6-9b77-fbc155470f5a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.311011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.312431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.312779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.313120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] PATH_INFO: `/v3/users/5d722aa5fcc14d29b296cd0a0f69d69c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.314435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d722aa5fcc14d29b296cd0a0f69d69c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.345412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.348517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 997/1982] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:43 2021] POST /identity/v3/users => generated 289 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:44.352482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.354394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:44.367189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3867d-d775-43cd-b6e1-7bd04a98c4c9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.372113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.375817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.375817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.375817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.375817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.405285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.421401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 998/1983] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:44 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:44.422355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.433552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0611a-b5b4-41e0-841c-67bef7df94e5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.441075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.441075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.441075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.441384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] PATH_INFO: `/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.462680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5809390448f45e5a6fbae13de996bf0, user_id=2bc584de2042453f92a7041abf2114b3, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.494488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.542576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 999/1984] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:44 2021] PUT /identity/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:44.546909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.599252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d722aa5fcc14d29b296cd0a0f69d69c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.609053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d722aa5fcc14d29b296cd0a0f69d69c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.632316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b98ef1-6f44-47a7-9b01-e0b4f8e731d7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.636965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.637646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.638015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.638870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.639657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.669501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.680942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1000/1985] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:44 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:44.685274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.693991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d722aa5fcc14d29b296cd0a0f69d69c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.694666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d722aa5fcc14d29b296cd0a0f69d69c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.703826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a3271-8f7e-40f9-87c8-147b49d418d0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:44.711160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:44.712277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d722aa5fcc14d29b296cd0a0f69d69c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:44.713180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:44.714136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:44.714550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] PATH_INFO: `/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:44.718027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5809390448f45e5a6fbae13de996bf0, user_id=2bc584de2042453f92a7041abf2114b3, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:44.720864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 986/1986] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:44 2021] DELETE /identity/v3/users/5d722aa5fcc14d29b296cd0a0f69d69c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:44.758611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:44.771516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1001/1987] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:44 2021] PUT /identity/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:44.775586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:44.777174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:44.901151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6b36-3897-45c0-bf13-193b143a4e42 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:45.005384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:45.006135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.006510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.007011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.008218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:45.041203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cab63-fc7c-4fdc-b90a-3d4d6eaf4aae admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:45.053888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 987/1988] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:44 2021] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:45.058182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:45.070418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a28356-dff0-4b97-8fce-ff0458f3d497 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:45.075212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:45.076317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.076742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.077161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] PATH_INFO: `/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.079644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5809390448f45e5a6fbae13de996bf0, user_id=2bc584de2042453f92a7041abf2114b3, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:45.111862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:45.157680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1002/1989] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:45 2021] PUT /identity/v3/projects/c5809390448f45e5a6fbae13de996bf0/users/2bc584de2042453f92a7041abf2114b3/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:45.169651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.170032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.170373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.232123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] MFA Rules not processed for user `2bc584de2042453f92a7041abf2114b3`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:45.233846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:45.323414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 988/1990] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:45 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:45.334522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:45.336375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:45.417994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f53d8-cb1d-4e67-bb77-2899c274db59 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:45.423024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:45.423690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.424000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.424328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.436424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:45.472315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:45.483114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1003/1991] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:45 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:45.601630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:45.603264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:45.656032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:45.666707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e4c6-9bda-433a-a6f3-8791ad64fac1 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:45.671748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:45.672638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.673187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.673707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.675790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:45.683049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71217906-6b5b-4a6d-82db-6ccb91ed943a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:45.687750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:45.688627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.688965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.689307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] PATH_INFO: `/v3/projects/e3771c03176a424882f1b59df0034bcf` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.690534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3771c03176a424882f1b59df0034bcf)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:45.719840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:45.751901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:45.781103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da2a128-f209-451d-97bf-5232588d4db4 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:45.795711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1004/1992] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:45 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:45.803895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3771c03176a424882f1b59df0034bcf', 'request_id': 'req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:45.809629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3771c03176a424882f1b59df0034bcf', 'request_id': 'req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:45.838614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3771c03176a424882f1b59df0034bcf', 'request_id': 'req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:45.856953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] The token cache is being invalidate because project e3771c03176a424882f1b59df0034bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:45.857178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:45.857819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66e91f1d-4554-43cd-94f2-bd34bc70e9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:45.859553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 989/1993] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:45 2021] DELETE /identity/v3/projects/e3771c03176a424882f1b59df0034bcf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:45.866984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.867332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.867664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:45.893120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:45.894762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:45.970101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1005/1994] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:45.973742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:45.974298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:45.974781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.004307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:46.006114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:46.014305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 990/1995] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:46.020199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.030282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2c8d2-515b-4107-8171-44147431b7bf None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.034933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.035914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.036174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.036513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.037287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:46.037638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.067849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.082792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1006/1996] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:27:46.089586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.099185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4a300-baca-4e2c-9403-ee514cd3265d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.103848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.104508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.104852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.105185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.105972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.135021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.205098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 991/1997] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:46 2021] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:46.209586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.220099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd8f8-cee0-4e45-a94f-472406071435 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.294927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.295627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.295964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.298008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.298008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.326360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.375548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1007/1998] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:46 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:46.379980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.391188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945d369-c824-4559-9177-cd02af93e6fa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.396246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.396931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.397271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.397604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.398432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.427457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3fb54-97ac-40d3-a7ae-b6210cbf0bf1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.439690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 992/1999] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:46 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:46.444262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.463360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31423c-3482-406c-acea-d1eca77e7435 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.468806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.469984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.470185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.470365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] PATH_INFO: `/v3/projects/d8ebdeef76fa4a96a954bed205028f42/users/07c173179bdc4e9b8ec9d50f166ef499/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.492148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ebdeef76fa4a96a954bed205028f42, user_id=07c173179bdc4e9b8ec9d50f166ef499, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.523837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.580813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1008/2000] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:46 2021] PUT /identity/v3/projects/d8ebdeef76fa4a96a954bed205028f42/users/07c173179bdc4e9b8ec9d50f166ef499/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:46.592634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.592996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.593309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.636075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] MFA Rules not processed for user `07c173179bdc4e9b8ec9d50f166ef499`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:46.637302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:46.714026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 993/2001] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:46 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:46.719628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.805420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6743-be10-4f44-baed-8a966a950c09 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:46.810941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:46.811903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:46.812238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:46.812567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:46.813292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:46.849029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:46.911365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1009/2002] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:46 2021] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:46.915843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:46.930669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce070e-62c6-4a70-a14c-6e26eaa49ff5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.040713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.041867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.042498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.046255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.046255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:47.077537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:47.137088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 994/2003] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:46 2021] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:47.141509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:47.155454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac62e-8a03-408c-9b61-9f58cb1f0b5a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.160978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.161923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.162936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.163865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.164845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:47.205033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a3a6f-1ccf-44da-bf09-e148808c4587 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:47.222825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1010/2004] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:47.232966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:47.247891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c092a-2520-4fbe-8fc2-17a80c949f1a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.262161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.262161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.262161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.262467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] PATH_INFO: `/v3/projects/748576a8167e471cb989ec9c5db4e6bb/users/ff4ef45ce6544741963281b62e8923e1/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.292509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748576a8167e471cb989ec9c5db4e6bb, user_id=ff4ef45ce6544741963281b62e8923e1, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:47.326337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:47.393653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 995/2005] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:47 2021] PUT /identity/v3/projects/748576a8167e471cb989ec9c5db4e6bb/users/ff4ef45ce6544741963281b62e8923e1/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:47.395142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.395568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.395828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.438557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] MFA Rules not processed for user `ff4ef45ce6544741963281b62e8923e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:47.439872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:47.521085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1011/2006] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:47 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:47.525960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:47.623920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8ff8e-00b5-4c01-b8bd-64d95ea73a13 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.630051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.630923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.631538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.632051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.632977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:47.665148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:47.742385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 996/2007] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:47 2021] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:27:47.746682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:47.777708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5df2a5-c505-4716-8ef7-a9f8835a367f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.881825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.882588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.882995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.883415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.884234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:47.916050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:47.965536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1012/2008] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:47 2021] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:47.969894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:47.982691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cf674-8562-4048-a4f2-4dc265b81df6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:47.988952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:47.989772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:47.990217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:47.990628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:47.991496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.025458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.040817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 997/2009] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:47 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:48.045707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.056085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116830ed-014c-4d00-9b2c-4124dc5bebc3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.060764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.061663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.062055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.062390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] PATH_INFO: `/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.083198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3446217b4424f7db18de2c7023f049e, user_id=909b841f295847d88fd5af0cd68c1a07, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.113330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.150994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1013/2010] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:48 2021] PUT /identity/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:48.155697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.166197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be599df-7fc4-4c76-ad4c-2032c5f4158e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.231887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.233180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.233525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.233921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.234708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.262730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.277168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 998/2011] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:48.278450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.289735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81b70e-087c-4a8d-9266-c06499c9d1d9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.294992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.295949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.296240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.296573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] PATH_INFO: `/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.298615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3446217b4424f7db18de2c7023f049e, user_id=909b841f295847d88fd5af0cd68c1a07, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.327739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.338951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1014/2012] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:48 2021] PUT /identity/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:48.343706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.353877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8415b-ca01-42bf-b244-7bc28e56c285 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.422803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.423524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.423869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.424203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.424988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.453273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51101531-d91c-4c6a-89ea-bd09e5fd75d7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.464264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 999/2013] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:48 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:48.468791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.479293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddf05c-5b72-43e7-8e4d-af8d09a7472f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.484297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.485191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.485527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.485886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] PATH_INFO: `/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.487850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3446217b4424f7db18de2c7023f049e, user_id=909b841f295847d88fd5af0cd68c1a07, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.518284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.559799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1015/2014] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:48 2021] PUT /identity/v3/projects/f3446217b4424f7db18de2c7023f049e/users/909b841f295847d88fd5af0cd68c1a07/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:48.571006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.571360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.571701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.610889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] MFA Rules not processed for user `909b841f295847d88fd5af0cd68c1a07`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:48.612104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:48.690563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1000/2015] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:48 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:48.701870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.703611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:48.772507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bffb5d-81a3-4c33-89f1-6a0a9bdfbd58 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.776133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.776793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.777131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.777504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:48.787759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:48.817295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:48.828247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1016/2016] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:48 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:48.979005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:48.992080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d6805-5651-43e7-a7a7-5cc7cb77f81f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:48.995823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:48.996485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:48.996824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:48.997155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:49.080777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:49.112917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6b93d-4fe5-4221-8f0c-09b211d6940b service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:49.123627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1001/2017] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:48 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:51.474542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:51.476450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:51.569687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9fa32-d517-4ff5-8038-8928dc3702f8 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:51.575325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:51.576845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:51.577304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:51.577739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] PATH_INFO: `/v3/users/23eb7cd820394fc0ba4590d0a5f5853b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:51.579082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23eb7cd820394fc0ba4590d0a5f5853b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:51.624129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:51.785183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23eb7cd820394fc0ba4590d0a5f5853b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:51.801454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23eb7cd820394fc0ba4590d0a5f5853b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:51.860734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23eb7cd820394fc0ba4590d0a5f5853b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:51.861442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23eb7cd820394fc0ba4590d0a5f5853b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:51.883191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23eb7cd820394fc0ba4590d0a5f5853b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:51.891498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1017/2018] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:51 2021] DELETE /identity/v3/users/23eb7cd820394fc0ba4590d0a5f5853b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:51.896309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:51.896662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:51.897001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:51.925110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:51.926393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:52.015879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1002/2019] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:52.027977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:52.030496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:52.148370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31745a49-d833-4c47-9127-4ed71392a8e6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:52.157970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:52.158811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:52.159777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:52.160126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:52.175274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:52.227181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:52.251482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1018/2020] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:53.459456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:53.462032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:53.476446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85d4cb-07c3-413f-8779-8ddb12b5eb07 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:53.485086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:53.487219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:53.487978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:53.488499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] PATH_INFO: `/v3/projects/0b6d4c83e87b4591af5db9a32f6daa23` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:53.490178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6d4c83e87b4591af5db9a32f6daa23)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:53.563322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:53.719492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6d4c83e87b4591af5db9a32f6daa23', 'request_id': 'req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:53.733184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6d4c83e87b4591af5db9a32f6daa23', 'request_id': 'req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:53.765273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6d4c83e87b4591af5db9a32f6daa23', 'request_id': 'req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:53.818438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] The token cache is being invalidate because project 0b6d4c83e87b4591af5db9a32f6daa23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:53.818784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:53.822237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:53.827771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1003/2021] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:53 2021] DELETE /identity/v3/projects/0b6d4c83e87b4591af5db9a32f6daa23 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:53.836638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:53.858491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246b88f-29f1-49cc-86ab-ae1c8ab8b3f6 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:54.066705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:54.068044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:54.068388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:54.068724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] PATH_INFO: `/v3/users/2bc584de2042453f92a7041abf2114b3` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:54.072504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc584de2042453f92a7041abf2114b3)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:54.137514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:54.310294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc584de2042453f92a7041abf2114b3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:54.352919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc584de2042453f92a7041abf2114b3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:54.387374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc584de2042453f92a7041abf2114b3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:54.388574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc584de2042453f92a7041abf2114b3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:54.415811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9abf4ce0-4602-494c-af35-c7fafe4108ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc584de2042453f92a7041abf2114b3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:54.427854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1019/2022] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:53 2021] DELETE /identity/v3/users/2bc584de2042453f92a7041abf2114b3 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:54.711849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:54.714073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:54.739811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd17be-ca4a-4a4d-a401-4f4650ac37d8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:54.894878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:54.895963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:54.896309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:54.896648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] PATH_INFO: `/v3/users/07c173179bdc4e9b8ec9d50f166ef499` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:54.897897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c173179bdc4e9b8ec9d50f166ef499)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:54.943796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:55.078391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c173179bdc4e9b8ec9d50f166ef499'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:55.090480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c173179bdc4e9b8ec9d50f166ef499'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:55.124743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c173179bdc4e9b8ec9d50f166ef499'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:55.125390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c173179bdc4e9b8ec9d50f166ef499'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:55.156469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c173179bdc4e9b8ec9d50f166ef499'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:55.178410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1004/2023] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:54 2021] DELETE /identity/v3/users/07c173179bdc4e9b8ec9d50f166ef499 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:55.181931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:55.182400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:55.182949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:55.211095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:55.212425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:55.315442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1020/2024] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:55.352006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:55.353455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:55.517205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adebcc8-effb-455b-bc45-4e2cfa7bc794 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:55.531225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:55.532277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:55.532988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:55.533479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:55.555941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:55.592992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef984151-1f51-4020-9d6d-863b5ba7bdd9 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:55.610224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1005/2025] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:55.805304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:55.806538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:55.833504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a801e5-e005-4b2c-bf17-daf1750f6a4e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:55.838915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:55.839823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:55.840163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:55.840494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] PATH_INFO: `/v3/users/d4bd106ff9ab4d80bec18bda15508b44` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:55.843544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bd106ff9ab4d80bec18bda15508b44)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:55.912741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:56.149320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bd106ff9ab4d80bec18bda15508b44'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:56.180542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bd106ff9ab4d80bec18bda15508b44'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:56.231923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bd106ff9ab4d80bec18bda15508b44'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:56.233195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bd106ff9ab4d80bec18bda15508b44'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:56.264065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c7cc36ca-3721-436a-97d6-ffe5e39b60ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bd106ff9ab4d80bec18bda15508b44'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:56.284585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1021/2026] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:55 2021] DELETE /identity/v3/users/d4bd106ff9ab4d80bec18bda15508b44 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:56.289947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.289947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.290278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.291019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247afb-664f-4958-a8e3-b6076ba16ebf None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.291369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247afb-664f-4958-a8e3-b6076ba16ebf None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.291704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2247afb-664f-4958-a8e3-b6076ba16ebf None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.302003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1022/2027] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:27:56 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:27:56.337807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:56.343078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:56.424581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.425748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.431798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.447380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1006/2028] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:56.470476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:56.473403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:56.499057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] MFA Rules not processed for user `d950460ecfe846a7ab6f4933bd97454e`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:56.502778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:56.691490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4d8d7-f107-4bb2-8414-e6c8b985b81d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:56.699804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:56.700664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.701020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.701338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.727326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:56.744336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1023/2029] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:27:56 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:56.775240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:56.787989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1007/2030] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:27:56.860123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:56.861763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:56.888189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951079f-4202-4d4c-9eec-8c7cf0f77b27 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:56.896902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:56.899020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:56.944048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7b4c-32dc-409a-bbb9-4cbf5281d6e2 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:56.944947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:56.947425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.950781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.952312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.969397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:56.970525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:56.971154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:56.975074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] PATH_INFO: `/v3/projects/c5809390448f45e5a6fbae13de996bf0` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:56.977249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5809390448f45e5a6fbae13de996bf0)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:56.991934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.061688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.070429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bfa89-3904-4938-99fb-f4f7c91ce038 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.108039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1024/2031] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:27:56 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:27:57.208195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5809390448f45e5a6fbae13de996bf0', 'request_id': 'req-b8764f01-2607-491c-9c92-3e2cec3ac353'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.214882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5809390448f45e5a6fbae13de996bf0', 'request_id': 'req-b8764f01-2607-491c-9c92-3e2cec3ac353'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.242397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5809390448f45e5a6fbae13de996bf0', 'request_id': 'req-b8764f01-2607-491c-9c92-3e2cec3ac353'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.262204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] The token cache is being invalidate because project c5809390448f45e5a6fbae13de996bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:57.262543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.263281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.264872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1008/2032] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:56 2021] DELETE /identity/v3/projects/c5809390448f45e5a6fbae13de996bf0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:57.271392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb102-90e9-40d9-9f4c-fdb9a5544963 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.271882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb102-90e9-40d9-9f4c-fdb9a5544963 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.272388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb102-90e9-40d9-9f4c-fdb9a5544963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.302269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cefeb102-90e9-40d9-9f4c-fdb9a5544963 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:57.303409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cefeb102-90e9-40d9-9f4c-fdb9a5544963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:57.363682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.365227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:57.442259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1025/2033] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:57.443881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.444233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.444569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.478637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:57.479888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:57.488697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1026/2034] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:57.494514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.501921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8764f01-2607-491c-9c92-3e2cec3ac353 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.504969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326e7e3-1442-4c13-a4d4-ef83933fffff None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.507128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.508022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.508369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.508698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] PATH_INFO: `/v3/projects/d8ebdeef76fa4a96a954bed205028f42` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.510135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ebdeef76fa4a96a954bed205028f42)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.510623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.511316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.511649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.511976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.513679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:27:57.514058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.543102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.545913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.564576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1027/2035] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:27:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:27:57.570821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.587196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c98dda-f66f-4071-9891-32df9866a552 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.593924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.595778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.595778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.595778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.596841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.627969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.641140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ebdeef76fa4a96a954bed205028f42', 'request_id': 'req-f0f7549c-03e9-4284-bd0d-b1f8508b4140'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.648953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ebdeef76fa4a96a954bed205028f42', 'request_id': 'req-f0f7549c-03e9-4284-bd0d-b1f8508b4140'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.683291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1028/2036] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:57 2021] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:57.685581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.693824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ebdeef76fa4a96a954bed205028f42', 'request_id': 'req-f0f7549c-03e9-4284-bd0d-b1f8508b4140'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.714173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] The token cache is being invalidate because project d8ebdeef76fa4a96a954bed205028f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:57.714742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.715552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:57.719927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1009/2037] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:57 2021] DELETE /identity/v3/projects/d8ebdeef76fa4a96a954bed205028f42 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:57.723859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.725337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:57.813209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac93ef0-5b34-4332-98a6-fd59991dff2c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.817888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.818501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.818842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.819231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.820030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.834680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7549c-03e9-4284-bd0d-b1f8508b4140 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.847986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.848896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.851006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.851351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] PATH_INFO: `/v3/users/ff4ef45ce6544741963281b62e8923e1` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.853557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4ef45ce6544741963281b62e8923e1)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:57.853672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.910956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:57.922847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1029/2038] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:57 2021] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:27:57.932936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:57.935053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:57.952657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65efe2cd-7d6a-437f-9043-51b4d31fd4a4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:57.958392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:57.959385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:57.959868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:57.960336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:57.961359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:58.040589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4ef45ce6544741963281b62e8923e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:58.042491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:58.060106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1030/2039] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:57 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:27:58.060456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4ef45ce6544741963281b62e8923e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:58.061476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:58.076483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c259f7-0bc4-4ca1-9f02-a5af3403380c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:58.091317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:58.092437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:58.092888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:58.093331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] PATH_INFO: `/v3/projects/7c69a4ffb18747d0805f67557875b7f0/users/091fbcf3727543bf9190308a09719c53/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:58.095971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4ef45ce6544741963281b62e8923e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:58.097056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4ef45ce6544741963281b62e8923e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:58.117106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c69a4ffb18747d0805f67557875b7f0, user_id=091fbcf3727543bf9190308a09719c53, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:58.120066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c836cb38-383b-4375-843c-1a7e9e62d2c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4ef45ce6544741963281b62e8923e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:58.127751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1010/2040] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:57 2021] DELETE /identity/v3/users/ff4ef45ce6544741963281b62e8923e1 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:27:58.150481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:58.194685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1031/2041] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:58 2021] PUT /identity/v3/projects/7c69a4ffb18747d0805f67557875b7f0/users/091fbcf3727543bf9190308a09719c53/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:58.206110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:58.206604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:58.207077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:58.296637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] MFA Rules not processed for user `091fbcf3727543bf9190308a09719c53`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:27:58.297887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:58.436304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1011/2042] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:27:58 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:27:58.441462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:58.443332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:58.569192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdaedb-1d35-4662-93ea-8f01b321db42 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:58.575787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:58.576700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:58.577072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:58.577828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:58.578644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:58.613055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:58.732236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1032/2043] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:27:58 2021] POST /identity/v3/projects => generated 369 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:58.736546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:58.752555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f376d68-5d6a-4b62-aaf0-daa613d44a7a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:58.938494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:58.938494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:58.938494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:58.938494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:58.939392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:58.966043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:58.975877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:58.996651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.034772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb454-c573-40fe-8f9f-38efa6306fff admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.056013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.056725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.057061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.057530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] PATH_INFO: `/v3/projects/43291870e0254dd8aae778f37631af5d` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.059216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=43291870e0254dd8aae778f37631af5d)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.095260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.101390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1012/2044] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:27:58 2021] POST /identity/v3/users => generated 291 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:27:59.104532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.140384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe7947-b03c-4a76-94a9-bb036a9556a2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.145425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.146141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.147159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.147159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.147697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.186473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.200777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43291870e0254dd8aae778f37631af5d', 'request_id': 'req-5909619c-4594-4af9-a987-3014c607c85c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.212246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1013/2045] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:59.213867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43291870e0254dd8aae778f37631af5d', 'request_id': 'req-5909619c-4594-4af9-a987-3014c607c85c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.217626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.232158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bcf8d-eae6-4153-8908-3843d751f8e7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.260144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43291870e0254dd8aae778f37631af5d', 'request_id': 'req-5909619c-4594-4af9-a987-3014c607c85c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.292581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] The token cache is being invalidate because project 43291870e0254dd8aae778f37631af5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:59.293056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.293805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.296018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1033/2046] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:58 2021] DELETE /identity/v3/projects/43291870e0254dd8aae778f37631af5d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:59.296941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.301988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:59.336551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.337931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.338698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.339204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] PATH_INFO: `/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.364319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b13faab1f4b87b0b450567c47601d, user_id=0b2d63b8dff3430091721a1128975a68, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.393506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909619c-4594-4af9-a987-3014c607c85c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.398491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.399422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.399551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.399836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.400280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] PATH_INFO: `/v3/projects/748576a8167e471cb989ec9c5db4e6bb` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.401594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=748576a8167e471cb989ec9c5db4e6bb)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.433153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.453638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1014/2047] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:59 2021] PUT /identity/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:59.454685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.457730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:59.518149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748576a8167e471cb989ec9c5db4e6bb', 'request_id': 'req-ca569191-4699-4e02-8d07-08bf7a79f86e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.523388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748576a8167e471cb989ec9c5db4e6bb', 'request_id': 'req-ca569191-4699-4e02-8d07-08bf7a79f86e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.534513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09670d86-53d9-41e2-84ed-fded6a05087b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.556320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748576a8167e471cb989ec9c5db4e6bb', 'request_id': 'req-ca569191-4699-4e02-8d07-08bf7a79f86e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.574181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] The token cache is being invalidate because project 748576a8167e471cb989ec9c5db4e6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:27:59.574518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.575336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.576892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1034/2048] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:27:59 2021] DELETE /identity/v3/projects/748576a8167e471cb989ec9c5db4e6bb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:59.577735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.579123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:59.603804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.604705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.605039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.605375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] PATH_INFO: `/v3/users/79dacc9edff64aa597e308d3a9166085` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.607215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=79dacc9edff64aa597e308d3a9166085)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.635328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.654029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca569191-4699-4e02-8d07-08bf7a79f86e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.659604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.660543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.660889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.661226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.662050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.690551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.705675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1035/2049] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:27:59.705675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.707379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:59.720355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c38d5-6703-4d62-823a-910d5585d431 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.724986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.725903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.726246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.726605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] PATH_INFO: `/v3/users/909b841f295847d88fd5af0cd68c1a07` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.727830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909b841f295847d88fd5af0cd68c1a07)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.742216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79dacc9edff64aa597e308d3a9166085'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.750895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79dacc9edff64aa597e308d3a9166085'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.756236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.796731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79dacc9edff64aa597e308d3a9166085'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.797445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79dacc9edff64aa597e308d3a9166085'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.811042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79dacc9edff64aa597e308d3a9166085'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.817767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1015/2050] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:59 2021] DELETE /identity/v3/users/79dacc9edff64aa597e308d3a9166085 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:59.818895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.820291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:27:59.877348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909b841f295847d88fd5af0cd68c1a07'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.888494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909b841f295847d88fd5af0cd68c1a07'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.911928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ac8ed-7a77-447e-9238-068511e58f4c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:27:59.917314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:27:59.918262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:27:59.918602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:27:59.918988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] PATH_INFO: `/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:27:59.921024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b13faab1f4b87b0b450567c47601d, user_id=0b2d63b8dff3430091721a1128975a68, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:27:59.951665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:27:59.958387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909b841f295847d88fd5af0cd68c1a07'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.960868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909b841f295847d88fd5af0cd68c1a07'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:27:59.963825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1016/2051] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:27:59 2021] PUT /identity/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:27:59.971041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:27:59.973020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:00.002400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909b841f295847d88fd5af0cd68c1a07'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.009448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1036/2052] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:27:59 2021] DELETE /identity/v3/users/909b841f295847d88fd5af0cd68c1a07 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:00.057334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436e1cb-366d-47a2-8567-4bfc19805311 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:00.145352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:00.145825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.146151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.146480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.147272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:00.175625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378331e1-ab8e-4def-8570-3249533afaad admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:00.188507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1017/2053] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:27:59 2021] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:00.192882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:00.203736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9285f1c-b7ce-43a0-8479-4599edb71642 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:00.208515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:00.209745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.209745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.210086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] PATH_INFO: `/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.212411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b13faab1f4b87b0b450567c47601d, user_id=0b2d63b8dff3430091721a1128975a68, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:00.241525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:00.284592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1037/2054] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:00 2021] PUT /identity/v3/projects/4e6b13faab1f4b87b0b450567c47601d/users/0b2d63b8dff3430091721a1128975a68/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:00.296377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.296733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.297269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.337300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] MFA Rules not processed for user `0b2d63b8dff3430091721a1128975a68`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:00.338601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:00.422223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1018/2055] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:00 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:00.432408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:00.435108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:00.523222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:00.524725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:00.553470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544d72d-7b0a-4d13-92cf-032d1313d32b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:00.574153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:00.575007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.576385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.576385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.601393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:00.629973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72480577-6ae2-4d2d-b1a5-bb1843196782 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:00.633901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f8a0-a74a-41f3-b938-2fabfe5e0165 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:00.640586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:00.641501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.641889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.642233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] PATH_INFO: `/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.646015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1038/2056] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:00 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:00.656506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfbaf6b5ee44ced8b57d9ffddb500bf)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:00.696876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:00.809910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfbaf6b5ee44ced8b57d9ffddb500bf', 'request_id': 'req-a372d80f-f808-4c55-b1df-b42c1dfe2be8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.816023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfbaf6b5ee44ced8b57d9ffddb500bf', 'request_id': 'req-a372d80f-f808-4c55-b1df-b42c1dfe2be8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.844141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfbaf6b5ee44ced8b57d9ffddb500bf', 'request_id': 'req-a372d80f-f808-4c55-b1df-b42c1dfe2be8'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.864872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] The token cache is being invalidate because project 8cfbaf6b5ee44ced8b57d9ffddb500bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:00.865224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.865968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a372d80f-f808-4c55-b1df-b42c1dfe2be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:00.867759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1019/2057] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:00 2021] DELETE /identity/v3/projects/8cfbaf6b5ee44ced8b57d9ffddb500bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:00.874228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.874581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.874920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:00.908102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:00.909290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:00.985230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1039/2058] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:00.998675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:00.999289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:00.999748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.050907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:01.052237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.061552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1020/2059] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:01.066040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.076397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af900ed-b570-41fc-9052-f6e83736c2d0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.081321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.082016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.089087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.091378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.096238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.096825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.097516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:01.097909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.103783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed55ea-4a9a-4711-82e3-b7087abfd20d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.113069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.114190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.114672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.115151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] PATH_INFO: `/v3/projects/f3446217b4424f7db18de2c7023f049e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.122125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3446217b4424f7db18de2c7023f049e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.140900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.154230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.174874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1040/2060] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:01.174874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.183595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b97b-f3b0-4cc6-9bf9-d0d44a973636 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.189102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.189971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.190475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.190815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.191562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.226387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.246311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3446217b4424f7db18de2c7023f049e', 'request_id': 'req-2cc18391-80ca-4941-a42d-40ea4e6b07b2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:01.251631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3446217b4424f7db18de2c7023f049e', 'request_id': 'req-2cc18391-80ca-4941-a42d-40ea4e6b07b2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:01.284263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3446217b4424f7db18de2c7023f049e', 'request_id': 'req-2cc18391-80ca-4941-a42d-40ea4e6b07b2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:01.295753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1041/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:01.296907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.303585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] The token cache is being invalidate because project f3446217b4424f7db18de2c7023f049e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:01.304070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:01.304869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2cc18391-80ca-4941-a42d-40ea4e6b07b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:01.312208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1021/2062] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:01 2021] DELETE /identity/v3/projects/f3446217b4424f7db18de2c7023f049e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:01.313990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca848b-e0f5-4000-9195-40d25b217082 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.314418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca848b-e0f5-4000-9195-40d25b217082 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.315214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca848b-e0f5-4000-9195-40d25b217082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.342657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c0ca848b-e0f5-4000-9195-40d25b217082 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:01.344007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0ca848b-e0f5-4000-9195-40d25b217082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.373606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1edcf2-3851-42bd-a01e-258b11ebf945 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.378724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.379408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.379753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.380208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.380886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.411452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.423720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1022/2063] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:01.429113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.429561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.430123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.459869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:01.461132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.469629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1023/2064] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:01.474093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.483956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ca0a-f06f-4591-a1ce-88ad7aaf17e6 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.493230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.493230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.493230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.493230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.493527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:01.493527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.499948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1042/2065] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:01.501113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.503091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.515923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057fe68-296b-4947-81e9-a524bfd13c12 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.520496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.521161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.521539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.521896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.522789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.524291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.538989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1024/2066] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:28:01.543615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.551399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.553523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7047d66-61b7-448a-8ff5-fc1ed1b29a03 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.558174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.558816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.559153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.560014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.560737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.566876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1043/2067] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:01.568200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.579578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27dd7-2d05-4d98-b4af-409884cff30b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.584296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.585479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.585826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.586277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] PATH_INFO: `/v3/projects/fa8ad18d8f9245859d063ef1f509ec3b/users/4be5e1946212490d9fc196b6470c30db/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.592734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.609730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8ad18d8f9245859d063ef1f509ec3b, user_id=4be5e1946212490d9fc196b6470c30db, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.640837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a224-4c45-4809-9708-8c590674299a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.651588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1025/2068] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:01.656230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:01.712024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1044/2069] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:01 2021] PUT /identity/v3/projects/fa8ad18d8f9245859d063ef1f509ec3b/users/4be5e1946212490d9fc196b6470c30db/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:01.720137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322977-a851-40ad-a4db-e25056d88561 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.720592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322977-a851-40ad-a4db-e25056d88561 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.721033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31322977-a851-40ad-a4db-e25056d88561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.745361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde76b0-dfe5-4473-a9c7-58539bfc8e0f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:01.813589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-31322977-a851-40ad-a4db-e25056d88561 None None] MFA Rules not processed for user `4be5e1946212490d9fc196b6470c30db`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:01.824226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-31322977-a851-40ad-a4db-e25056d88561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:01.859956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:01.860866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:01.861511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:01.862086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:01.863469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:01.894170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:01.963779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1026/2070] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/users => generated 284 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:01.975580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:02.009731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1045/2071] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:01 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:02.024400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31322977-a851-40ad-a4db-e25056d88561 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:02.026849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-31322977-a851-40ad-a4db-e25056d88561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:02.027584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f337ba2-d334-42ca-bef0-6f36a4324049 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:02.043244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:02.043974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:02.044325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:02.044655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:02.045656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:02.104808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:02.117218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1027/2072] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:01 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:02.129499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:02.142691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ddf8-4eef-4247-b3e8-3a0b59cebf81 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:02.148160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31322977-a851-40ad-a4db-e25056d88561 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:02.171344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:02.172414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:02.172760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:02.173095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] PATH_INFO: `/v3/projects/edc9e8f20b1b49bcad00766b6ed51432/users/2c14fec0a6f84758ae2202f90f1ba806/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:02.177509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:02.178291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:02.180719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:02.181233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:02.222508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc9e8f20b1b49bcad00766b6ed51432, user_id=2c14fec0a6f84758ae2202f90f1ba806, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:02.232215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:02.275751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:02.318007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b1d1f-480b-47e8-9067-8e68985ff26f service glance] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:02.360715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1046/2073] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:02 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:02.362031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1028/2074] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:02 2021] PUT /identity/v3/projects/edc9e8f20b1b49bcad00766b6ed51432/users/2c14fec0a6f84758ae2202f90f1ba806/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:02.378375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:02.378375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:02.378375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:02.509827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] MFA Rules not processed for user `2c14fec0a6f84758ae2202f90f1ba806`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:02.511087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:02.657931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1047/2075] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:02 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:02.678114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:02.850061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4ad1f-531a-4cbf-b866-eeec6b40f60f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:02.858785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:02.859784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:02.860847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:02.861381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:02.862355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:02.902914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:02.985149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1029/2076] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:02 2021] POST /identity/v3/projects => generated 365 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:02.989328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.005850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46f7a7-11d6-4a3e-b0e9-b3f7ee54068f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.095552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.098169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.098169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.098169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.098702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.132915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.191028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1048/2077] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:02 2021] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:03.194520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.209301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3240-c836-47dd-8625-26cf19edcfa6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.214429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.215105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.215593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.215934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.216949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.250751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.269610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1030/2078] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:03.274577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.289343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6a2fd-34c6-48bc-ac33-fe0e64aef59f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.297405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.297405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.297405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.297681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] PATH_INFO: `/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.342259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67712fe68b574dee9dc828c5a2cba01e, user_id=063cc7864b6947d795ec653140bd35fa, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.356355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.397220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1049/2079] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:03 2021] PUT /identity/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:03.401678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.413160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf3b2d-d8c5-47b2-99ef-fbf351c539dc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.493242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.494262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.494805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.495381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.496362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.529910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.542762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1031/2080] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:03.559569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.574437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4925e4f-ca56-4267-b09d-593f88e6c87d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.585099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.586079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.586473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.586804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] PATH_INFO: `/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.588846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] RBAC: Authorizing `identity:create_grant(project_id=67712fe68b574dee9dc828c5a2cba01e, user_id=063cc7864b6947d795ec653140bd35fa, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.623423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.639105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1050/2081] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:03 2021] PUT /identity/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:03.640419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.653388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c307-675d-458b-8891-0a461af21624 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.789170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.789893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.790241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.790575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.791370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:03.826129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa07f8-48e2-4f84-ba73-fd9a9cbca1ec admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:03.839714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1032/2082] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:03 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:03.844064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:03.860173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67421abb-e9c3-42d5-9615-e64bab68569a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:03.875218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:03.876703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:03.877044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:03.877516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] PATH_INFO: `/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:03.884844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67712fe68b574dee9dc828c5a2cba01e, user_id=063cc7864b6947d795ec653140bd35fa, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:04.021015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:04.082369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1051/2083] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:03 2021] PUT /identity/v3/projects/67712fe68b574dee9dc828c5a2cba01e/users/063cc7864b6947d795ec653140bd35fa/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:04.095048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:04.095395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:04.095829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:04.166694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] MFA Rules not processed for user `063cc7864b6947d795ec653140bd35fa`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:04.168173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:04.323822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1033/2084] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:04 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:04.342734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:04.344594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:04.507233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb5055-228e-48aa-875f-8473447a4d4f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:04.520534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:04.521726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:04.521726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:04.522339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:04.545106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:04.595233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:04.613126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1052/2085] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:04 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:04.842836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:04.844303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:04.856892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873838b-4cbd-4a3f-bc07-3aacb5174baa None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:04.861127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:04.862227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:04.862621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:04.863159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:04.867203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:04.868808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:04.954972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:04.996641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552389b8-1f59-4fa1-9b3c-1118c2f605c3 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:05.039999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1034/2086] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:04 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:05.070866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504c6ee-fae8-4648-8468-30ce4531f5b2 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:05.082870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:05.083880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:05.092349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:05.092735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] PATH_INFO: `/v3/users/091fbcf3727543bf9190308a09719c53` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:05.094565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091fbcf3727543bf9190308a09719c53)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:05.190093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:05.327134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091fbcf3727543bf9190308a09719c53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:05.348242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091fbcf3727543bf9190308a09719c53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:05.409671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091fbcf3727543bf9190308a09719c53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:05.410748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091fbcf3727543bf9190308a09719c53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:05.425001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091fbcf3727543bf9190308a09719c53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:05.432185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1053/2087] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:04 2021] DELETE /identity/v3/users/091fbcf3727543bf9190308a09719c53 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:05.437952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:05.438308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:05.438647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:05.486118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:05.491421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:05.593251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1035/2088] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:05.604024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:05.605553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:05.733130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951de56-dae4-4853-a5f2-8cb91e7d20d9 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:05.738347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:05.739573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:05.740106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:05.740777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:05.762080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:05.797200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:05.809710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1054/2089] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:06.601881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:06.603462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:06.632914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0370c0a-5677-49ef-9ae4-ec88e45bd2b7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:06.653614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:06.657673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:06.658055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:06.658406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] PATH_INFO: `/v3/projects/7c69a4ffb18747d0805f67557875b7f0` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:06.662013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c69a4ffb18747d0805f67557875b7f0)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:06.682112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:06.687016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:06.710790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429347f3-cce3-4d58-a8a0-98ebb44da6e2 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:06.719395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:06.720433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:06.720903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:06.721026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:06.721435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] PATH_INFO: `/v3/users/60bb104168a74bb3a98108f151cc29a2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:06.722773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60bb104168a74bb3a98108f151cc29a2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:06.786607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:06.910437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c69a4ffb18747d0805f67557875b7f0', 'request_id': 'req-70fb63f9-fb24-426a-8e8a-f616fe18d108'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:06.916077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c69a4ffb18747d0805f67557875b7f0', 'request_id': 'req-70fb63f9-fb24-426a-8e8a-f616fe18d108'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:06.977898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60bb104168a74bb3a98108f151cc29a2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:06.989566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60bb104168a74bb3a98108f151cc29a2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:06.998215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c69a4ffb18747d0805f67557875b7f0', 'request_id': 'req-70fb63f9-fb24-426a-8e8a-f616fe18d108'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.061061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60bb104168a74bb3a98108f151cc29a2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.061699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60bb104168a74bb3a98108f151cc29a2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.073899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] The token cache is being invalidate because project 7c69a4ffb18747d0805f67557875b7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:07.073899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.077833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.084736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1036/2090] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:06 2021] DELETE /identity/v3/projects/7c69a4ffb18747d0805f67557875b7f0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:07.086713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:07.091809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fd97b72e-617c-4403-b1d7-eca9f0a03abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60bb104168a74bb3a98108f151cc29a2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.096061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:07.104227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1055/2091] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:06 2021] DELETE /identity/v3/users/60bb104168a74bb3a98108f151cc29a2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:07.106817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:07.107163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:07.107494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:07.135772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:07.136928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:07.233760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1056/2092] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:07.243591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:07.245481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:07.247501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb63f9-fb24-426a-8e8a-f616fe18d108 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:07.260365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:07.261173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:07.261513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:07.264629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] PATH_INFO: `/v3/users/0b2d63b8dff3430091721a1128975a68` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:07.264629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2d63b8dff3430091721a1128975a68)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:07.296539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:07.337866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19677efe-eb99-4adc-a200-d8c1326e8a4d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:07.349327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:07.350677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:07.351517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:07.351927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:07.375555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:07.407992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:07.422035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1057/2093] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:07.423568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2d63b8dff3430091721a1128975a68'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.433063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2d63b8dff3430091721a1128975a68'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.458964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2d63b8dff3430091721a1128975a68'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.464642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2d63b8dff3430091721a1128975a68'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.485150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2d63b8dff3430091721a1128975a68'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:07.499339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1037/2094] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:07 2021] DELETE /identity/v3/users/0b2d63b8dff3430091721a1128975a68 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:08.175424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:08.177091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:08.195237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2b374-0311-47f7-838c-1e855a409350 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:08.271809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:08.273025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:08.273447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:08.273906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] PATH_INFO: `/v3/projects/639950c274fc415db6ac0374a6d59468` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:08.275458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=639950c274fc415db6ac0374a6d59468)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:08.307524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:08.402052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639950c274fc415db6ac0374a6d59468', 'request_id': 'req-16161636-bcf6-491e-9afb-58509db63d0c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.408813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639950c274fc415db6ac0374a6d59468', 'request_id': 'req-16161636-bcf6-491e-9afb-58509db63d0c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.444059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639950c274fc415db6ac0374a6d59468', 'request_id': 'req-16161636-bcf6-491e-9afb-58509db63d0c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.466582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] The token cache is being invalidate because project 639950c274fc415db6ac0374a6d59468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:08.467282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.469774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.471581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1058/2095] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:08 2021] DELETE /identity/v3/projects/639950c274fc415db6ac0374a6d59468 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:08.475967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:08.477470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:08.491056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fac6f6-3e3e-45e8-94a2-0020532e7678 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:08.530835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:08.532527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:08.585012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:08.585838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:08.586221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:08.586723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] PATH_INFO: `/v3/users/de88994c917c4a49b4eecd8d60b5f97d` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:08.587960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=de88994c917c4a49b4eecd8d60b5f97d)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:08.616960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:08.618652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16161636-bcf6-491e-9afb-58509db63d0c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:08.624088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:08.625066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:08.625463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:08.625822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] PATH_INFO: `/v3/projects/4e6b13faab1f4b87b0b450567c47601d` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:08.627192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6b13faab1f4b87b0b450567c47601d)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:08.658629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:08.749418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6b13faab1f4b87b0b450567c47601d', 'request_id': 'req-370d3923-b5ca-45bd-ba88-a76a7b32c7da'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.755137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6b13faab1f4b87b0b450567c47601d', 'request_id': 'req-370d3923-b5ca-45bd-ba88-a76a7b32c7da'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.786971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6b13faab1f4b87b0b450567c47601d', 'request_id': 'req-370d3923-b5ca-45bd-ba88-a76a7b32c7da'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.806202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] The token cache is being invalidate because project 4e6b13faab1f4b87b0b450567c47601d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:08.806541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.807257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-370d3923-b5ca-45bd-ba88-a76a7b32c7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.809160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1059/2096] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:08 2021] DELETE /identity/v3/projects/4e6b13faab1f4b87b0b450567c47601d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:08.816596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:08.817292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:08.817406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:08.826745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de88994c917c4a49b4eecd8d60b5f97d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.836078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de88994c917c4a49b4eecd8d60b5f97d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.846008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:08.846873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:08.878539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de88994c917c4a49b4eecd8d60b5f97d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.879279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de88994c917c4a49b4eecd8d60b5f97d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.897166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3d6154-af87-4b2c-8eec-ae3e3641e09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de88994c917c4a49b4eecd8d60b5f97d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:08.905171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1038/2097] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:08 2021] DELETE /identity/v3/users/de88994c917c4a49b4eecd8d60b5f97d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:08.945250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1060/2098] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:08.953275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040307-a544-41e7-944c-438222beb993 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:08.961903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040307-a544-41e7-944c-438222beb993 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:08.962290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2040307-a544-41e7-944c-438222beb993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.070998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c2040307-a544-41e7-944c-438222beb993 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:09.072437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c2040307-a544-41e7-944c-438222beb993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:09.232559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1039/2099] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:09.241214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.257046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf631d6-53ac-4db8-9879-9d6c6e38229f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.265207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.265929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.266275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.266611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.267411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:09.267763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.296435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.314900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1061/2100] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:09.316680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040307-a544-41e7-944c-438222beb993 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.330932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2040307-a544-41e7-944c-438222beb993 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.337590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.338319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.338672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.339006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.339775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.375204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.455667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1040/2101] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:09 2021] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:09.460006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.480505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e620ae5-3b7b-4297-bdce-8319ef0028a2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.612885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.613829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.614487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.615125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.616006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.646818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.649899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:09.663665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.681449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57bde0-a009-411f-b97c-c3cdbfa6c876 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.687569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.688947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.689615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.690066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] PATH_INFO: `/v3/projects/c33053cc4ae1457fb692d1de69620450` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.691408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33053cc4ae1457fb692d1de69620450)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.711376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1062/2102] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:09 2021] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:09.715471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.724048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.725506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41eeaa-a81b-44da-9fed-67cfc5750828 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.741679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.742584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.749056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.749056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.749056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.776684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.795005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1063/2103] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:09 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:09.799375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:09.812352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b74a2-166c-4470-bcfe-2b4d0b098a94 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:09.817608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:09.818827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.819356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.820182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] PATH_INFO: `/v3/projects/2fc34e1192564a598c55043bc4b1cd29/users/e439555e40484f6ba4d8d4f1bb9559b9/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.861883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc34e1192564a598c55043bc4b1cd29, user_id=e439555e40484f6ba4d8d4f1bb9559b9, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:09.894485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33053cc4ae1457fb692d1de69620450', 'request_id': 'req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:09.899534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30937daf-7ff8-49ec-a1cb-9236f828c21e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:09.903717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33053cc4ae1457fb692d1de69620450', 'request_id': 'req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:09.955712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1064/2104] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:09 2021] PUT /identity/v3/projects/2fc34e1192564a598c55043bc4b1cd29/users/e439555e40484f6ba4d8d4f1bb9559b9/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:09.967689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:09.969026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:09.969517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:09.992582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33053cc4ae1457fb692d1de69620450', 'request_id': 'req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:10.028643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] The token cache is being invalidate because project c33053cc4ae1457fb692d1de69620450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:10.029663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:10.033863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5a8de8b7-9bcd-4a8a-b18d-bf6d8d07de84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:10.036089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1041/2105] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:09 2021] DELETE /identity/v3/projects/c33053cc4ae1457fb692d1de69620450 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:10.051187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda5d3-568e-4799-9649-2349c3179a81 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.051536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda5d3-568e-4799-9649-2349c3179a81 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.051879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcda5d3-568e-4799-9649-2349c3179a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.069356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] MFA Rules not processed for user `e439555e40484f6ba4d8d4f1bb9559b9`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:10.071386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:10.098637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3bcda5d3-568e-4799-9649-2349c3179a81 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:10.100603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3bcda5d3-568e-4799-9649-2349c3179a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:10.161880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1065/2106] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:09 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:10.166799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.168930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:10.196657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1042/2107] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:10.204918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.205464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.205835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.239175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:10.241376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:10.254804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1043/2108] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:10.256315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.266892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325b9e0-cf1f-4b8f-bc0f-d7b80f9f74a0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.272330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.273223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.273767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.274322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.275564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:10.276116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.293396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527862a-b3d7-4c48-a488-2ec9d51937c0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.308566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.309319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.309656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.310039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.310867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.318354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.334747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1044/2109] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:10.339128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.350315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24832cf-21b2-4416-a753-0d23ac340e3d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.355481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.356372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.356717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.357054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.357821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.370841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.388760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.447730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1066/2110] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:10.452446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.479071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1045/2111] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:10.481662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.582376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fd13-75a0-4a16-a47b-fe3d14262e24 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.690616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.691763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.692410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.692856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.696098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.736444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.764445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b67e1-253d-4b41-80c3-d10e5b97aad1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.769395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.770123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.770465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.771305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.772045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.798077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1067/2112] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/users => generated 294 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:10.802424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.807997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.826051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79774e9-fcc4-4cf5-ba4c-023b21d8b8d7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.839016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.840003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.840003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.840854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.841651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.867595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1046/2113] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:10 2021] POST /identity/v3/users => generated 283 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:10.873515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.892615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:10.898222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017722eb-596f-4d29-9a49-3f5e899ccb54 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.907292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1068/2114] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:10 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:10.909603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.910757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.911277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.911797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.912799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.912905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:10.925154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d685803-dcea-4af6-a8cc-6f39248937b7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:10.930778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:10.932075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:10.932421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:10.932758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] PATH_INFO: `/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:10.970032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b714f598ea74a7b84f2de58eb3e72c6, user_id=a960a6cbd33d44b0b264a625d6cb20c0, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:10.977962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.002517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1047/2115] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:10 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:11.006585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.018514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea26e-84aa-45b7-9674-a0f2716561df admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.024739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.026214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.026749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.027269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] PATH_INFO: `/v3/projects/a2a5a115fede4fb29f44a8b6ed8b47ce/users/c1349c3796794569b9ca09b38d8032b9/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.041783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.061671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a5a115fede4fb29f44a8b6ed8b47ce, user_id=c1349c3796794569b9ca09b38d8032b9, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.102396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98809ea-585a-4da9-8a4d-165574111256 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.118576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1069/2116] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:10 2021] PUT /identity/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:11.123601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.148481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1048/2117] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:11 2021] PUT /identity/v3/projects/a2a5a115fede4fb29f44a8b6ed8b47ce/users/c1349c3796794569b9ca09b38d8032b9/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:11.160326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.160770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.161125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.244849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] MFA Rules not processed for user `c1349c3796794569b9ca09b38d8032b9`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:11.246380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:11.250553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4690d-34bd-4423-9155-1c5eb8214692 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.340967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.341690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.342107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.342443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.344091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.376915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.390685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1070/2118] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:11.395087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.412668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21d4cc-2f7f-49c7-8032-701110fb2920 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.414850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1049/2119] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:11 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:11.420033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.433683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.436713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.437171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.437592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] PATH_INFO: `/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.438919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca936bef-1964-4174-8ab0-e6371199835a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.442508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b714f598ea74a7b84f2de58eb3e72c6, user_id=a960a6cbd33d44b0b264a625d6cb20c0, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.455785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.456567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.456989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.457405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.458290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.494238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.515645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1071/2120] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:11 2021] PUT /identity/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:11.523948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.547258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.727165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96868b1d-af4b-4059-86bc-c57c8cddbf4c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.727165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.727165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.727165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.728548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.728548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.728548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.728548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1072/2121] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:11 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:11.728548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.740569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7d12a-ba5d-4537-a674-ce6a37e664b3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.746573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:11.747740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.748661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.749154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] PATH_INFO: `/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.754280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b714f598ea74a7b84f2de58eb3e72c6, user_id=a960a6cbd33d44b0b264a625d6cb20c0, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:11.796422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1050/2122] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:11 2021] POST /identity/v3/projects => generated 363 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:11.856912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d3523-1874-496f-bc03-984b8e63ccd1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:11.857380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:11.923289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1073/2123] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:11 2021] PUT /identity/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6/users/a960a6cbd33d44b0b264a625d6cb20c0/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:11.936227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:11.936985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:11.937442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:11.983103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5ab3a-c58b-4cb6-8c67-b0b472272e96 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:11.988595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] MFA Rules not processed for user `a960a6cbd33d44b0b264a625d6cb20c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:11.990005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:12.117701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1074/2124] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:11 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:12.128682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.134326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:12.164386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.165231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.165723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.166234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.167123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.210668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.296951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cd96f-1c99-4b23-8ff6-6a55f83e572c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:12.304791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1051/2125] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:11 2021] POST /identity/v3/users => generated 288 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:12.308719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.309419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.310252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.310698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.311132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.329046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9d251-a30b-43be-bca6-9e55e85e0e7a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:12.353559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.354601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.355217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.355737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.356617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.389643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.404071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1052/2126] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:12 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:12.407355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.423678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330dcae2-d67c-432f-b015-687fff806835 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:12.429436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.441499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.442824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.444133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.444687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] PATH_INFO: `/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.490632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.496476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2a038fdba94371a4736d16efc5e9c1, user_id=adf21c63792a477fb813b538451923ce, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.508273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1075/2127] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:12 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:12.527208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.570772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1053/2128] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:12 2021] PUT /identity/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:12.575031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.588213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676355d-2755-4ae6-9945-fe3ec4dbef1c service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:12.693046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.693949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.694397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.694840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.696214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.731059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.752643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1076/2129] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:12 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:12.752845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.770820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ef0d-f571-4a5f-a0da-12dc30cc4d0f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:12.790428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:12.794731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:12.795254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:12.795779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] PATH_INFO: `/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:12.808734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2a038fdba94371a4736d16efc5e9c1, user_id=adf21c63792a477fb813b538451923ce, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:12.884711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:12.922945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1054/2130] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:12 2021] PUT /identity/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:12.927283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:12.943181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa953-272d-4e0e-998f-19203490b623 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:13.104448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:13.105195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.105635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.107409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.116537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:13.143825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cc16a-7d9f-4147-aaf3-1a836ce50809 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:13.173755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1077/2131] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:12 2021] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:13.173979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:13.174921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7ac2-070f-49bf-bab2-2c830ec0d5b9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:13.179886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:13.180917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.181373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.181841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] PATH_INFO: `/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.184356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2a038fdba94371a4736d16efc5e9c1, user_id=adf21c63792a477fb813b538451923ce, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:13.216555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:13.288174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1055/2132] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:13 2021] PUT /identity/v3/projects/ac2a038fdba94371a4736d16efc5e9c1/users/adf21c63792a477fb813b538451923ce/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:13.290014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.290391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.290727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.375287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] MFA Rules not processed for user `adf21c63792a477fb813b538451923ce`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:13.377428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:13.430706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:13.432620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:13.559716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1498-8a2a-4a19-b55f-7fc1633af5a5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:13.580911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:13.581733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.582106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.582443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] PATH_INFO: `/v3/users/2c14fec0a6f84758ae2202f90f1ba806` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.587039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c14fec0a6f84758ae2202f90f1ba806)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:13.611316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1078/2133] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:13 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:13.622939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:13.624422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:13.637849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:13.760050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672a229-4596-4478-8c84-24ed3bc8d802 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:13.769085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:13.769085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.769085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.769085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.780585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:13.802435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c14fec0a6f84758ae2202f90f1ba806'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:13.813256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c14fec0a6f84758ae2202f90f1ba806'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:13.818797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526165e0-b5fc-4fe4-b12f-e9f31ae1b1bd service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:13.832076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1079/2134] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:13 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:13.855679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c14fec0a6f84758ae2202f90f1ba806'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:13.856697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c14fec0a6f84758ae2202f90f1ba806'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:13.873189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c14fec0a6f84758ae2202f90f1ba806'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:13.884457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1056/2135] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:13 2021] DELETE /identity/v3/users/2c14fec0a6f84758ae2202f90f1ba806 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:13.890912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:13.891266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:13.891608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:13.919378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:13.920990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.072627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1080/2136] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:14.079975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:14.082896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.171877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fec22b-1510-4c10-a862-b8fbd4b5f8e7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:14.176601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:14.177418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:14.178019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:14.178369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:14.190088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:14.220481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1508f-5e83-473d-a1d8-a8306537f3d7 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:14.231467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1057/2137] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:14.247311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:14.248949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.267488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9461d0-d95f-4ab7-b643-ea20f80a0e36 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:14.272469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:14.273456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:14.273901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:14.274315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] PATH_INFO: `/v3/users/c1349c3796794569b9ca09b38d8032b9` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:14.275918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1349c3796794569b9ca09b38d8032b9)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:14.333511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:14.469631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1349c3796794569b9ca09b38d8032b9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:14.498522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1349c3796794569b9ca09b38d8032b9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:14.535222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1349c3796794569b9ca09b38d8032b9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:14.535831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1349c3796794569b9ca09b38d8032b9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:14.553564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1349c3796794569b9ca09b38d8032b9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:14.563608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1081/2138] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:14 2021] DELETE /identity/v3/users/c1349c3796794569b9ca09b38d8032b9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:14.568262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:14.568497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:14.568834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:14.620159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:14.622620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.753611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1058/2139] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:14.777229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:14.779432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.866842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec1188-50d7-4938-957e-ef814e6e2baf admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:14.877353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:14.878602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:14.879147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:14.879666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:14.891628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:14.923772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:14.926086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:14.949017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c0a86-47b2-4d2f-8120-75248bab54ba None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:14.959092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:14.964163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:14.967280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:14.967701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:14.968140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] PATH_INFO: `/v3/projects/edc9e8f20b1b49bcad00766b6ed51432` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:14.970660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc9e8f20b1b49bcad00766b6ed51432)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:14.978266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1082/2140] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:14 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:15.023048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:15.138312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc9e8f20b1b49bcad00766b6ed51432', 'request_id': 'req-71437201-fd86-44f0-af5d-eb99a2ba6ee0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.145707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc9e8f20b1b49bcad00766b6ed51432', 'request_id': 'req-71437201-fd86-44f0-af5d-eb99a2ba6ee0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.202096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc9e8f20b1b49bcad00766b6ed51432', 'request_id': 'req-71437201-fd86-44f0-af5d-eb99a2ba6ee0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.220196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] The token cache is being invalidate because project edc9e8f20b1b49bcad00766b6ed51432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:15.220532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.221239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.222983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1059/2141] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:14 2021] DELETE /identity/v3/projects/edc9e8f20b1b49bcad00766b6ed51432 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:15.227449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:15.240162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d48578-e640-41ce-a80e-97e631548220 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:15.316328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:15.317329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:15.317739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:15.318211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] PATH_INFO: `/v3/users/063cc7864b6947d795ec653140bd35fa` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:15.319533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=063cc7864b6947d795ec653140bd35fa)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:15.351529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:15.469644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063cc7864b6947d795ec653140bd35fa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.479054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063cc7864b6947d795ec653140bd35fa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.518236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063cc7864b6947d795ec653140bd35fa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.519246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063cc7864b6947d795ec653140bd35fa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.533961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063cc7864b6947d795ec653140bd35fa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.543415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1083/2142] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:15 2021] DELETE /identity/v3/users/063cc7864b6947d795ec653140bd35fa => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:15.617811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:15.619229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:15.639559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437201-fd86-44f0-af5d-eb99a2ba6ee0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:15.747695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:15.748590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:15.752334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:15.752334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] PATH_INFO: `/v3/projects/a2a5a115fede4fb29f44a8b6ed8b47ce` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:15.752334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a5a115fede4fb29f44a8b6ed8b47ce)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:15.779913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:15.880681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a5a115fede4fb29f44a8b6ed8b47ce', 'request_id': 'req-0e04734b-4a36-407a-91fa-b994ab5913d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.887630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a5a115fede4fb29f44a8b6ed8b47ce', 'request_id': 'req-0e04734b-4a36-407a-91fa-b994ab5913d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.935572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a5a115fede4fb29f44a8b6ed8b47ce', 'request_id': 'req-0e04734b-4a36-407a-91fa-b994ab5913d4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.995189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] The token cache is being invalidate because project a2a5a115fede4fb29f44a8b6ed8b47ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:15.998811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.998811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:15.998811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1060/2143] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:15 2021] DELETE /identity/v3/projects/a2a5a115fede4fb29f44a8b6ed8b47ce => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:16.002170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.003922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:16.032203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafcfeb-2ea9-45d9-a33e-48fb587b83bb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.067724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.069679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:16.124328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.125166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.125501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.125865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] PATH_INFO: `/v3/users/adf21c63792a477fb813b538451923ce` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.127779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf21c63792a477fb813b538451923ce)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.159142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.161858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04734b-4a36-407a-91fa-b994ab5913d4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.167369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.169013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.169434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.169870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] PATH_INFO: `/v3/projects/67712fe68b574dee9dc828c5a2cba01e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.171215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67712fe68b574dee9dc828c5a2cba01e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.208267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.289837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67712fe68b574dee9dc828c5a2cba01e', 'request_id': 'req-5f06ced1-5fc0-4b18-bda3-ec12847a2598'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.295512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67712fe68b574dee9dc828c5a2cba01e', 'request_id': 'req-5f06ced1-5fc0-4b18-bda3-ec12847a2598'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.314880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf21c63792a477fb813b538451923ce'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.323219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf21c63792a477fb813b538451923ce'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.323824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67712fe68b574dee9dc828c5a2cba01e', 'request_id': 'req-5f06ced1-5fc0-4b18-bda3-ec12847a2598'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.343364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] The token cache is being invalidate because project 67712fe68b574dee9dc828c5a2cba01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:16.343700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.344387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5f06ced1-5fc0-4b18-bda3-ec12847a2598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.346006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1061/2144] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:16 2021] DELETE /identity/v3/projects/67712fe68b574dee9dc828c5a2cba01e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:16.352297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.352646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.352981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.353280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf21c63792a477fb813b538451923ce'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.353987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf21c63792a477fb813b538451923ce'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.368059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c173c3ab-0e0f-4b01-8717-b8b6fe9a574a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf21c63792a477fb813b538451923ce'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:16.376612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:16.377884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:16.384340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1084/2145] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:16 2021] DELETE /identity/v3/users/adf21c63792a477fb813b538451923ce => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:16.461607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1062/2146] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:16.471565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.472078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.472225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.507789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:16.509029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:16.517204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1085/2147] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:16.521924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.535043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea616085-7db8-40e3-a781-7c6220226302 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.540097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.542493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.542493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.542493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.542493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:16.542889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.571841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.590356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1063/2148] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:16.591984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.601685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22b56-f83a-47dc-bfb5-d2c2101dc535 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.606808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.607276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.607870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.607983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.608639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.638363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.704819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1086/2149] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:16 2021] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:16.709166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.720065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45058f7-4d15-4008-bdf4-456453871b16 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.793484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.794250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.803388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.803388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.803388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.825365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.859852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.863919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:16.876121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1064/2150] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:16 2021] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:16.877621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b956e5-dd3e-45a1-a6d6-b2bd4a97276d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.880257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.883050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.883767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.884152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.884431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] PATH_INFO: `/v3/projects/ac2a038fdba94371a4736d16efc5e9c1` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.885658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2a038fdba94371a4736d16efc5e9c1)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.890990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcadd2-4015-432a-b23e-fefacbcc1bf6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.896124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.896592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.896934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.897266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.898187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:16.915486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.928382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:16.940918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1065/2151] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:16 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:16.944885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:16.954932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d5a36-452a-488e-b19d-ee17cc6b1510 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:16.959706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:16.960605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:16.962900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:16.962900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] PATH_INFO: `/v3/projects/43951e232f85445a85759063131294aa/users/ffc11be2bed145b2aa2d9d0313063c29/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:16.983461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=43951e232f85445a85759063131294aa, user_id=ffc11be2bed145b2aa2d9d0313063c29, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.002930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2a038fdba94371a4736d16efc5e9c1', 'request_id': 'req-a695ff03-1656-46b7-b1f1-54ed6df69032'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:17.009178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2a038fdba94371a4736d16efc5e9c1', 'request_id': 'req-a695ff03-1656-46b7-b1f1-54ed6df69032'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:17.014670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a701e16-8433-4aa1-b238-f4f9f97914fa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.044257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2a038fdba94371a4736d16efc5e9c1', 'request_id': 'req-a695ff03-1656-46b7-b1f1-54ed6df69032'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:17.065087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] The token cache is being invalidate because project ac2a038fdba94371a4736d16efc5e9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:17.065539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:17.066359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a695ff03-1656-46b7-b1f1-54ed6df69032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:17.068536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1087/2152] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:16 2021] DELETE /identity/v3/projects/ac2a038fdba94371a4736d16efc5e9c1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:17.073236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1066/2153] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:16 2021] PUT /identity/v3/projects/43951e232f85445a85759063131294aa/users/ffc11be2bed145b2aa2d9d0313063c29/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:17.076443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.076794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.077157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.078524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d469c3-6f16-48cc-94f3-7266c7d1fb98 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.078863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d469c3-6f16-48cc-94f3-7266c7d1fb98 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.079203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d469c3-6f16-48cc-94f3-7266c7d1fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.101634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:17.102900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:17.103010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e2d469c3-6f16-48cc-94f3-7266c7d1fb98 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:17.104351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2d469c3-6f16-48cc-94f3-7266c7d1fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:17.176240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1067/2154] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:17.177155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1088/2155] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:17.185948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.186307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.186728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.187878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.189279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:17.210658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:17.211979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:17.221861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1068/2156] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:17.224472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.235462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd92d4-8604-4074-b36b-d8856049ec38 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.241300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.242114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.242584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.242923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.245971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:17.245971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.264041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7ddec-fff5-4dda-ad53-749a66f19b71 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.267653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.268304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.268641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.268968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.272883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.278950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.288178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1069/2157] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:28:17.292835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.303187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1367ff-a4ff-4994-aea9-8a6f2c735fc8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.307693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.308015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.308678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.309051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.309386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.310155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.318690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1089/2158] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:17.339105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.427478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1070/2159] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:17.431985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.442136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f169e98-d883-4b69-a21c-9db6afc57ea2 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.528797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.529614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.540681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.540681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.540681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.560979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.617187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1090/2160] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/users => generated 278 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:17.622393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.634527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fc2d-1556-408d-964e-405fd5bc50c1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.639698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.640363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.640700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.641030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.641847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.671440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d0aea-303e-4945-923b-f5563b30c3ce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.684146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1071/2161] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:17 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:17.688699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:17.698914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581aa8-5244-4519-ae4f-09d1de2b490d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:17.703945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:17.704842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.705216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.705545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] PATH_INFO: `/v3/projects/55b14234ca4645358b79aa94eae6a25c/users/894c26024d8c46be8d3ccdc21a8c0bb2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.728441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b14234ca4645358b79aa94eae6a25c, user_id=894c26024d8c46be8d3ccdc21a8c0bb2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:17.757520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:17.816043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1091/2162] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:17 2021] PUT /identity/v3/projects/55b14234ca4645358b79aa94eae6a25c/users/894c26024d8c46be8d3ccdc21a8c0bb2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:17.827613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:17.828203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:17.828514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:17.868238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] MFA Rules not processed for user `894c26024d8c46be8d3ccdc21a8c0bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:17.869463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:17.947982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1072/2163] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/auth/tokens => generated 3662 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:17.952777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.031365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be48a-c6fd-45bd-a284-6f5867d23728 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.037106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.037958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.038131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.038587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.039372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.070315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.214648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1092/2164] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:17 2021] POST /identity/v3/projects => generated 357 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:18.215885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.226643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704b679-db0c-4de4-a1aa-042a8406c695 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.295107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.295791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.296128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.296462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.297183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.326442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.393664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1073/2165] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:18 2021] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:18.398027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.408536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f6014-2323-4d4e-9b5d-dd92bb187638 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.413502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.414215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.414558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.414889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.415672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.444912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.460901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1093/2166] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:18 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:18.462180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.472889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce588c2e-5580-43a5-ae87-78ab1f6a389e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.477454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.478414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.478751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.479084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] PATH_INFO: `/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.500195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5a8d798d084829b5b311da72a76054, user_id=76355b4eb9af48a18fd9b890722e398b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.530332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.570933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1074/2167] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:18 2021] PUT /identity/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:18.575881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.591381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586e92-4116-4192-95cc-8a1949f57ae3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.735848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.744605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.744605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.744605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.744605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.791622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4da247-6ea8-4f45-adf9-48d6cf0be093 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.817582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1094/2168] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:18 2021] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:18.822064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:18.842654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539dd-ed89-44d6-8745-0c8f8b253f22 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:18.850549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:18.852172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.852778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.853194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] PATH_INFO: `/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.855998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5a8d798d084829b5b311da72a76054, user_id=76355b4eb9af48a18fd9b890722e398b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:18.885234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:18.885584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:18.885950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:18.892827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:18.906347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1075/2169] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:18 2021] PUT /identity/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:18.912835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.002373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb74a6e-d430-4ded-b76b-f880f899915a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.007711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] MFA Rules not processed for user `ffc11be2bed145b2aa2d9d0313063c29`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:19.009011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.009216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.010149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.010591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.010979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.013455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.044607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.060925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1076/2170] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:18 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:19.067044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.081395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f8bef3-25e1-448e-b5ea-abe5a2247c29 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.088436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.089367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.090106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.090855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] PATH_INFO: `/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.093508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5a8d798d084829b5b311da72a76054, user_id=76355b4eb9af48a18fd9b890722e398b, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.130946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6c94a-1d81-4f3b-8f67-741fc2bae567 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.159964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1095/2171] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:18 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:19.165063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.168794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.191613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1077/2172] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:19 2021] PUT /identity/v3/projects/2d5a8d798d084829b5b311da72a76054/users/76355b4eb9af48a18fd9b890722e398b/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:19.193612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.194394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.194736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.214479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30760c7c-5e5a-4571-8813-5bcce22117c4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.248437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] MFA Rules not processed for user `76355b4eb9af48a18fd9b890722e398b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:19.249704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.295501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.296203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.296545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.296880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.297616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.329105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.399441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1078/2173] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:19 2021] POST /identity/v3/auth/tokens => generated 3731 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:19.400482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.401927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.471327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28244522-f87e-4028-9c04-de4f81825b51 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.478154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.478829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.479169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.479501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.481542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.501434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1096/2174] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:19 2021] POST /identity/v3/projects => generated 373 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:19.502237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.503949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:19.581895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.585528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f17533-181c-490c-88d2-f46e0f0daf38 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.593198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.593198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.593198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.593198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.623359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.637985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1079/2175] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:19 2021] GET /identity/v3/auth/tokens => generated 3749 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:19.639130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.654533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91328-c3e3-42d9-b499-d52fa2d1af9f service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.736072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.769862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.774031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.775096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.775449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.775933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.781447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:19.781558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1097/2176] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:19 2021] GET /identity/v3/auth/tokens => generated 3731 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:19.809635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:19.909021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1080/2177] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:19 2021] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:19.914600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:19.938490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd59e5-e2c9-4c79-8aaa-266edceeee6e service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:19.945847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:19.946798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:19.948068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:19.948669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:19.949730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.019648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.033764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.039432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1098/2178] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:19 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:20.046018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5d9b2-d938-432d-87c8-f9ad8778f34a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.051544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.054061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.054405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.054743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] PATH_INFO: `/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.081996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.096429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fabe8-4408-4808-8659-e0ed7b0324dd admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.102568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.104365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bbe11b1b6544c88e04aa3f08f7477a, user_id=71e0c2d3550146c59a7b1bc5cd675689, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.107707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.116995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.117344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.144880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.194180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1081/2179] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:20 2021] PUT /identity/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:20.198929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.219314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.251742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.262338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1099/2180] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:20 2021] GET /identity/v3/auth/tokens => generated 3662 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:20.292139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248f7d-ae39-4a51-8ead-b10e88df377c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.298656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.299507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.299854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.300192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.301705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.333794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.346292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1082/2181] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:20 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:20.350748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.362831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97d3eb-61ff-49d0-b1fa-09de18e487bd service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.368166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.369675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.370030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.370265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] PATH_INFO: `/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.372688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bbe11b1b6544c88e04aa3f08f7477a, user_id=71e0c2d3550146c59a7b1bc5cd675689, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.403950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.415909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1100/2182] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:20 2021] PUT /identity/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:20.424090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.434610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d435ac-d29f-4b62-832c-795429875e2f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.485262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.487096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:20.509953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.510719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.511075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.511408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.512267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.542562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.558386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1083/2183] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:20 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:20.559429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:20.570191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b35d78-c0fa-4c31-b12a-ccda466dbd6c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.572593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f28e9-ba0f-416e-ba91-301730d2dec7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:20.575111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.576033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.576373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.576751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] PATH_INFO: `/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.578688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bbe11b1b6544c88e04aa3f08f7477a, user_id=71e0c2d3550146c59a7b1bc5cd675689, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.578797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:20.579575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:20.579912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:20.580294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] PATH_INFO: `/v3/users/4ee7748418bc498eafdc8b1a00917502` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:20.581638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee7748418bc498eafdc8b1a00917502)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:20.609373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.618967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:20.654946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1084/2184] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:20 2021] PUT /identity/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a/users/71e0c2d3550146c59a7b1bc5cd675689/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:20.749514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee7748418bc498eafdc8b1a00917502'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:20.758010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee7748418bc498eafdc8b1a00917502'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:20.791837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee7748418bc498eafdc8b1a00917502'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:20.793046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee7748418bc498eafdc8b1a00917502'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:20.805674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f4c7682-914d-41ea-8353-0ca2046e3361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee7748418bc498eafdc8b1a00917502'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:20.812064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1101/2185] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:20 2021] DELETE /identity/v3/users/4ee7748418bc498eafdc8b1a00917502 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:21.405187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:21.407116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:21.496488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047ac14-ac73-485e-9da0-7a50743cf2c0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:21.577500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:21.578595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:21.578741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:21.579071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] PATH_INFO: `/v3/projects/1787c3f7bec742019e6b49604067909b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:21.581585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1787c3f7bec742019e6b49604067909b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:21.609876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:21.716780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1787c3f7bec742019e6b49604067909b', 'request_id': 'req-d933bc17-588d-47f3-aa91-6bedec2638a5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:21.724917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1787c3f7bec742019e6b49604067909b', 'request_id': 'req-d933bc17-588d-47f3-aa91-6bedec2638a5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:21.758130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1787c3f7bec742019e6b49604067909b', 'request_id': 'req-d933bc17-588d-47f3-aa91-6bedec2638a5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:21.779184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] The token cache is being invalidate because project 1787c3f7bec742019e6b49604067909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:21.779527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:21.780233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d933bc17-588d-47f3-aa91-6bedec2638a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:21.786065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1085/2186] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:21 2021] DELETE /identity/v3/projects/1787c3f7bec742019e6b49604067909b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:21.797746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:21.798204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:21.798542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:21.826785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:21.828320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:21.902205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1102/2187] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:21.911917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:21.912265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:21.912608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:21.937050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:21.938383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:21.946245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1086/2188] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:21.950922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:21.961325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62748f9-0eb6-41e7-9962-618eee952c87 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:21.973264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f85058-c155-4865-9350-890dce419918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:21.974195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f85058-c155-4865-9350-890dce419918 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:21.974663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f85058-c155-4865-9350-890dce419918 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:21.975117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f85058-c155-4865-9350-890dce419918 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:21.978778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f85058-c155-4865-9350-890dce419918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:21.978778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f85058-c155-4865-9350-890dce419918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.022777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f85058-c155-4865-9350-890dce419918 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.052950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1103/2189] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:22.053132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.062167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63897be-4229-4877-9120-8cb5e9c0bcfd None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.082850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.083199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.083542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.086921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.088104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.088708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.089281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.091275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.135104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.135968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] MFA Rules not processed for user `71e0c2d3550146c59a7b1bc5cd675689`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:22.138380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:22.213402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1087/2190] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/projects => generated 405 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:22.218215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.245956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1104/2191] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:22.257193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.258670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:22.297065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111838d-3f36-4c22-a7eb-4bea8dabf37b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.301718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.302434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.302776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.303110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.303840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.330968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb103b9-9d18-4bfb-84f1-b2558a4f02f0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.333698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.395169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.395842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.396181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.396515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.398578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:22.413783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1088/2192] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:22.415092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.425214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352098a3-9401-4f62-b7d8-906e09e7a42b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.432129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.433005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.433399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.433770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.434612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.463953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.475331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.479159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1089/2193] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:22 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:22.480225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.490364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657e97a-1a2d-40e0-8ec5-d8dbfaa73f58 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.495721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.497131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.497469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.497837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] PATH_INFO: `/v3/projects/caa6bb2669b74ce8888a29620bd9f7b2/users/141de0e615654918a48e3a0e4e27b151/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.504778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b783b9-0a29-45a2-b9d4-c4d346ebbaac service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.515430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1105/2194] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:22 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:22.519948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa6bb2669b74ce8888a29620bd9f7b2, user_id=141de0e615654918a48e3a0e4e27b151, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.549563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.590629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1090/2195] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:22 2021] PUT /identity/v3/projects/caa6bb2669b74ce8888a29620bd9f7b2/users/141de0e615654918a48e3a0e4e27b151/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:22.601130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.601482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.601852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.642124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] MFA Rules not processed for user `141de0e615654918a48e3a0e4e27b151`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:22.643343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:22.719013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1106/2196] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:22.723708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.799006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25348f-1e90-4d8e-8523-a4d45b535032 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.803683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.804368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.804708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.805046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.805777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:22.835280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:22.905743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1091/2197] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/projects => generated 405 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:22.910544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:22.922244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d661c9d-1d1d-4c8d-89b0-0f77f6da575c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:22.989828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:22.990642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:22.990991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:22.991330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:22.992063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.021687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.067324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1107/2198] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:22 2021] POST /identity/v3/users => generated 309 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:23.071845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.084916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07be202-7bcd-4dee-ba05-03f65d9fe854 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.090151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.090954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.091407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.091859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.093567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.125917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.139622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1092/2199] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:23 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:23.144028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.154484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b7fb4-3422-4b99-b506-db3327f3f83f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.159253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.160437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.160779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.161119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] PATH_INFO: `/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.189338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbff0d369344ab78eac05c1c9ca30b3, user_id=23884bda5789440e9f44c5d8d704acc2, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.219227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.268043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1108/2200] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:23 2021] PUT /identity/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:23.272225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.290219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acfbd87-606f-400b-aa4a-500734293a5c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.372492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.373302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.373945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.374365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.375404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.411710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.423499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1093/2201] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:23 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:23.428134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.439328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3a5a-40ac-4712-bea3-6022aada2482 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.443889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.444797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.445139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.445486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] PATH_INFO: `/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.447536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbff0d369344ab78eac05c1c9ca30b3, user_id=23884bda5789440e9f44c5d8d704acc2, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.477586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.488449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1109/2202] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:23 2021] PUT /identity/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:23.492683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.503843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a7ab7-1c10-42d6-b540-97232541d92e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.572882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.573571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.573959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.574948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.575735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.603728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee2b8-8d85-4338-b04b-5d8310e30257 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.614818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1094/2203] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:23 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:23.619354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.630213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19266bd-55bf-4db7-be72-58bf9159f841 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.634821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.635726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.636064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.636401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] PATH_INFO: `/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.639074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fbff0d369344ab78eac05c1c9ca30b3, user_id=23884bda5789440e9f44c5d8d704acc2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:23.669239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:23.736713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1110/2204] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:23 2021] PUT /identity/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3/users/23884bda5789440e9f44c5d8d704acc2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:23.748848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.749142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.749518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.789029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] MFA Rules not processed for user `23884bda5789440e9f44c5d8d704acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:23.790328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:23.885081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1095/2205] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:23 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:23.895309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:23.965689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566df77-055f-4ac2-a0a8-34377835bf5a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:23.970668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:23.971402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:23.971759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:23.972084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:23.983783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:24.016947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5767c2-ba77-4ab0-b780-01255a15f947 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:24.027935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1111/2206] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:23 2021] GET /identity/v3/auth/tokens => generated 3779 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:24.242249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:24.314135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c985c0b-74cb-4849-8370-1f6f73761b9c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:24.318579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:24.319488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:24.319808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:24.320136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] PATH_INFO: `/v3/users/141de0e615654918a48e3a0e4e27b151` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:24.321334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141de0e615654918a48e3a0e4e27b151)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:24.349958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:24.453605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141de0e615654918a48e3a0e4e27b151'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:24.461947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141de0e615654918a48e3a0e4e27b151'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:24.511946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141de0e615654918a48e3a0e4e27b151'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:24.512624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141de0e615654918a48e3a0e4e27b151'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:24.525418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141de0e615654918a48e3a0e4e27b151'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:24.531913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1096/2207] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:24 2021] DELETE /identity/v3/users/141de0e615654918a48e3a0e4e27b151 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:24.536947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:24.537300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:24.537611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:24.563172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:24.564497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:24.639698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1112/2208] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:24.652068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:24.654248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:24.723857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0841b-5505-4e11-afcc-0b286899b553 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:24.727754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:24.728419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:24.728766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:24.729106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:24.738734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:24.767995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:24.777915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1097/2209] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:25.369103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:25.370876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:25.407881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:25.409529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:25.441000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae443a3-d4fa-46d3-a145-7c6ff26e2e58 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:25.445644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474637ca-ca72-431d-a793-17e5d0782c84 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:25.449948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:25.450102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:25.450767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:25.451107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:25.451442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:25.451827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:25.452309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:25.452761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] PATH_INFO: `/v3/projects/caa6bb2669b74ce8888a29620bd9f7b2` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:25.453607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:25.454349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa6bb2669b74ce8888a29620bd9f7b2)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:25.484396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:25.535748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:25.564964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:25.579898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1113/2210] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:25 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:25.623606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa6bb2669b74ce8888a29620bd9f7b2', 'request_id': 'req-6e4e2802-3841-488c-9e1b-0942ec5b8994'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:25.628754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa6bb2669b74ce8888a29620bd9f7b2', 'request_id': 'req-6e4e2802-3841-488c-9e1b-0942ec5b8994'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:25.664967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa6bb2669b74ce8888a29620bd9f7b2', 'request_id': 'req-6e4e2802-3841-488c-9e1b-0942ec5b8994'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:25.684328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] The token cache is being invalidate because project caa6bb2669b74ce8888a29620bd9f7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:25.684756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:25.685507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:25.687397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1098/2211] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:25 2021] DELETE /identity/v3/projects/caa6bb2669b74ce8888a29620bd9f7b2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:25.692612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:25.706653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e54ca-6191-4110-bcdb-02d1979a94b0 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:25.780795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:25.782006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:25.782728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:25.783285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] PATH_INFO: `/v3/users/23884bda5789440e9f44c5d8d704acc2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:25.785394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] RBAC: Authorizing `identity:delete_user(user_id=23884bda5789440e9f44c5d8d704acc2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:25.817503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:26.051695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23884bda5789440e9f44c5d8d704acc2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.059944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23884bda5789440e9f44c5d8d704acc2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.094932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23884bda5789440e9f44c5d8d704acc2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.095684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23884bda5789440e9f44c5d8d704acc2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.109075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-85b8e2da-fdbf-434d-a89d-e55e4b1a317a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23884bda5789440e9f44c5d8d704acc2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.115550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1114/2212] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:25 2021] DELETE /identity/v3/users/23884bda5789440e9f44c5d8d704acc2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:26.620400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:26.622497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:26.640429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e2802-3841-488c-9e1b-0942ec5b8994 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:26.714328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:26.715814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:26.716326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:26.716666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] PATH_INFO: `/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:26.717940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fbff0d369344ab78eac05c1c9ca30b3)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:26.747068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:26.829859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fbff0d369344ab78eac05c1c9ca30b3', 'request_id': 'req-b1ad9b51-d421-48f9-83b9-d65823a96cc6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.835873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fbff0d369344ab78eac05c1c9ca30b3', 'request_id': 'req-b1ad9b51-d421-48f9-83b9-d65823a96cc6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.883442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fbff0d369344ab78eac05c1c9ca30b3', 'request_id': 'req-b1ad9b51-d421-48f9-83b9-d65823a96cc6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.902220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] The token cache is being invalidate because project 5fbff0d369344ab78eac05c1c9ca30b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:26.903086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.903767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b1ad9b51-d421-48f9-83b9-d65823a96cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:26.905418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1099/2213] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:26 2021] DELETE /identity/v3/projects/5fbff0d369344ab78eac05c1c9ca30b3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:26.911836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:26.912195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:26.912531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:26.936319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:26.937520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:27.007197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1115/2214] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:27.015949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006183-500a-442f-849d-4d053d6637bf None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.016301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006183-500a-442f-849d-4d053d6637bf None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.016643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006183-500a-442f-849d-4d053d6637bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.040349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7c006183-500a-442f-849d-4d053d6637bf None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:27.041606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7c006183-500a-442f-849d-4d053d6637bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:27.050902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1100/2215] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:27.055504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.066270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aadcd-e742-4a62-ae3d-5e3db48809fd None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.071208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.071887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.072225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.072554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.073838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:27.075020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.109183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.124448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1116/2216] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:27.129279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006183-500a-442f-849d-4d053d6637bf None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.139744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006183-500a-442f-849d-4d053d6637bf None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.144484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.145414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.145414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.145762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.146519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.176778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.264444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1101/2217] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:27 2021] POST /identity/v3/projects => generated 403 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:27.268886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.279814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ca5c-b386-430c-8622-2183dc4b3239 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.356625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.357309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.357645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.358035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.358762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.390936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.441916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1117/2218] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:27 2021] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:27.446363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.457948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b580f-8678-4f25-a39d-6702d34436c6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.463667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.464377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.464879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.465225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.469443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.500940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20638a-4579-4ad9-a3d5-d5cd293e60a9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.512624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1102/2219] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:27 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:27.521119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.533617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949dbf-78e3-49be-b28b-f52ce7041bc8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.538673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.539624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.539964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.540449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] PATH_INFO: `/v3/projects/49f701731b3640e18d923f9f538f2ab0/users/8676723b6d0c4cf09e4e18d63d394f40/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.563786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f701731b3640e18d923f9f538f2ab0, user_id=8676723b6d0c4cf09e4e18d63d394f40, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.594514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.632446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1118/2220] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:27 2021] PUT /identity/v3/projects/49f701731b3640e18d923f9f538f2ab0/users/8676723b6d0c4cf09e4e18d63d394f40/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:27.638610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c406-dd18-4cfc-af0e-c6c8ffdff6d1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.638993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c406-dd18-4cfc-af0e-c6c8ffdff6d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.639334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c406-dd18-4cfc-af0e-c6c8ffdff6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.664258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b926c406-dd18-4cfc-af0e-c6c8ffdff6d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:27.665495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b926c406-dd18-4cfc-af0e-c6c8ffdff6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:27.737242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1103/2221] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:27.749294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:27.751154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:27.830371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775156-1f3f-4b9a-b08c-e00a10d18cb8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:27.834291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:27.834953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:27.835293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:27.835623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:27.846043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:27.874757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:27.886637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1119/2222] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:28.963258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:28.965146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:28.972332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.022538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] MFA Rules not processed for user `8676723b6d0c4cf09e4e18d63d394f40`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:29.024120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:29.105826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1104/2223] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:28 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:29.107289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.117289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655effc-8097-4ce1-a5e6-8b8898100e13 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.122071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.122741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.123081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.123418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.124144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.153736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.220212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1120/2224] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:29 2021] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:29.221671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.232551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bb858-f648-4cfa-87b4-01c852033a65 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.301341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.302000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.302344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.302675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.303467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.333598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.378780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1105/2225] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:29 2021] POST /identity/v3/users => generated 308 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:29.382936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.394294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cee8-6c80-4a7a-b171-dca414fb96bb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.398826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.399488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.399827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.400159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.400933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.429336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.440631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1121/2226] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:29 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:29.445054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.455979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c7d9-6868-4403-821f-177d8900c956 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.460600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.461494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.461854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.462193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] PATH_INFO: `/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.482725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4862a05a21146e5b6e8e4bb5e6e949e, user_id=4baf608a37234965a2ab5d8eecf89526, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.513020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.549780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1106/2227] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:29 2021] PUT /identity/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:29.554026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.564602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc238c-0792-4f67-9c4b-750468ff097e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.631879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.632560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.632896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.633225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.634053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.662818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.674271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1122/2228] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:29 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:29.678667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.689603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e66fb-6e54-4e08-9dd2-27119398bd4e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.694186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.695080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.695418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.695750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] PATH_INFO: `/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.697712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4862a05a21146e5b6e8e4bb5e6e949e, user_id=4baf608a37234965a2ab5d8eecf89526, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.726636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.737514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1107/2229] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:29 2021] PUT /identity/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:29.741528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.752135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54e9d-5f06-4cf8-927b-d6d1079ee859 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.818522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.819137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.819480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.819818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.820594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.849695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3435-16f0-4748-88b9-b53f16f60cd4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.860863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1123/2230] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:29 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:29.865274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:29.875649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757bc4-d1fc-44bc-9f8c-d726ac144599 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:29.880268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:29.881171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:29.881507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:29.881883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] PATH_INFO: `/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:29.883853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4862a05a21146e5b6e8e4bb5e6e949e, user_id=4baf608a37234965a2ab5d8eecf89526, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:29.914735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:29.965281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1108/2231] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:29 2021] PUT /identity/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e/users/4baf608a37234965a2ab5d8eecf89526/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:31.409716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:31.410759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:31.411104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:31.452789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] MFA Rules not processed for user `4baf608a37234965a2ab5d8eecf89526`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:31.454523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:31.540641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1124/2232] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:31 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:33.340703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:33.413857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e397a-6e26-4b81-abd9-0f7ad2e1b331 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:33.418782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:33.419773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:33.420198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:33.420364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] PATH_INFO: `/v3/users/8676723b6d0c4cf09e4e18d63d394f40` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:33.421573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8676723b6d0c4cf09e4e18d63d394f40)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:33.450526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:33.563331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8676723b6d0c4cf09e4e18d63d394f40'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:33.571887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8676723b6d0c4cf09e4e18d63d394f40'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:33.609131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8676723b6d0c4cf09e4e18d63d394f40'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:33.610365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8676723b6d0c4cf09e4e18d63d394f40'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:33.628169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8676723b6d0c4cf09e4e18d63d394f40'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:33.635589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1109/2233] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:33 2021] DELETE /identity/v3/users/8676723b6d0c4cf09e4e18d63d394f40 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:33.887211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:33.898683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbce5c1-fe6f-482a-959d-a5057e2197d2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:33.969031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:33.969963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:33.970334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:33.970665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] PATH_INFO: `/v3/projects/49f701731b3640e18d923f9f538f2ab0` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:33.972500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f701731b3640e18d923f9f538f2ab0)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:34.002399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:34.087730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f701731b3640e18d923f9f538f2ab0', 'request_id': 'req-76e8044c-c747-4464-9860-02b8d927a96e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.093531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f701731b3640e18d923f9f538f2ab0', 'request_id': 'req-76e8044c-c747-4464-9860-02b8d927a96e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.144663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f701731b3640e18d923f9f538f2ab0', 'request_id': 'req-76e8044c-c747-4464-9860-02b8d927a96e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.164665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] The token cache is being invalidate because project 49f701731b3640e18d923f9f538f2ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:34.165003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.165696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.167299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1125/2234] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:33 2021] DELETE /identity/v3/projects/49f701731b3640e18d923f9f538f2ab0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:34.172279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:34.173762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:34.210794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3109-d5ec-46e5-afb0-208f926edce0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:34.294863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:34.295973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:34.296382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:34.296789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] PATH_INFO: `/v3/users/4baf608a37234965a2ab5d8eecf89526` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:34.298142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baf608a37234965a2ab5d8eecf89526)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:34.330194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:34.446380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baf608a37234965a2ab5d8eecf89526'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.455156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baf608a37234965a2ab5d8eecf89526'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.483401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baf608a37234965a2ab5d8eecf89526'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.484127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baf608a37234965a2ab5d8eecf89526'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.498099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-869f6c72-180c-4349-a342-22a117c1619f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baf608a37234965a2ab5d8eecf89526'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.504406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1110/2235] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:34 2021] DELETE /identity/v3/users/4baf608a37234965a2ab5d8eecf89526 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:34.775805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:34.777332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:34.790922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8044c-c747-4464-9860-02b8d927a96e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:34.855682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:34.856528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:34.856864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:34.857191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] PATH_INFO: `/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:34.858415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4862a05a21146e5b6e8e4bb5e6e949e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:34.887636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:34.957940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4862a05a21146e5b6e8e4bb5e6e949e', 'request_id': 'req-abc11fff-5835-4f02-9508-c117cc84b398'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.963249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4862a05a21146e5b6e8e4bb5e6e949e', 'request_id': 'req-abc11fff-5835-4f02-9508-c117cc84b398'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:34.991594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4862a05a21146e5b6e8e4bb5e6e949e', 'request_id': 'req-abc11fff-5835-4f02-9508-c117cc84b398'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:35.010078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] The token cache is being invalidate because project d4862a05a21146e5b6e8e4bb5e6e949e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:35.010407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:35.011220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abc11fff-5835-4f02-9508-c117cc84b398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:35.289327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1126/2236] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:34 2021] DELETE /identity/v3/projects/d4862a05a21146e5b6e8e4bb5e6e949e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:35.289416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1111/2237] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:35.289946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1127/2238] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:35.290404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.290404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6088a4-3a74-4e51-bd51-88592ec40a0e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.290404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.290404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.290697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1112/2239] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:28:35.291139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.291139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393d666-7a7f-44a1-a4c5-afad9d5b6e1c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.291139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.291139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.291427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.291427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.291427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.298537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.353674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1128/2240] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:35.357923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.369192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f12dff-5b38-46c7-a61f-73b12911b3a5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.437305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.438020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.438372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.438707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.439434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.468670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.512272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1113/2241] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:35.516633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.527628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb015fbb-48c1-4f82-9590-7bbe48296aca admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.532512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.533235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.533717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.534201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.535167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.564952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecaf3c-33fc-4022-aa35-7c5237c2318a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.576436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1129/2242] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:35 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:35.580851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.591412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015d7bf-0d03-4dec-99c7-fc15395f9622 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.595970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.596873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.597214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.597547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] PATH_INFO: `/v3/projects/609cfb1b5c2b4b51944f5c0839be3a00/users/392c9946af2e42fe9b6cbd4b18d41e89/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.618611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609cfb1b5c2b4b51944f5c0839be3a00, user_id=392c9946af2e42fe9b6cbd4b18d41e89, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.648267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.689229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1114/2243] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:35 2021] PUT /identity/v3/projects/609cfb1b5c2b4b51944f5c0839be3a00/users/392c9946af2e42fe9b6cbd4b18d41e89/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:35.700396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.700745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.701086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.739028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] MFA Rules not processed for user `392c9946af2e42fe9b6cbd4b18d41e89`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:35.740225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:35.819408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1130/2244] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:35.824574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:35.896536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ce5e2-5dae-4727-98a4-0ce8af1559f7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:35.901192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:35.904751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:35.904751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:35.904751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:35.904751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:35.932433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:35.997358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1115/2245] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:35.998633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.009851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee449c47-781c-4f3a-a32b-9537fd5e026b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.076631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.077314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.077657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.078021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.078760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.107102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.151521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1131/2246] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:35 2021] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:36.156022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.166541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc499c0-3f11-480e-bcc4-d12153bc7145 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.171042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.171707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.172044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.172376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.173158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.202302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.213849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1116/2247] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:36 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:36.218206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.228213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a717-fb04-4711-bfd1-f16860c11b65 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.233255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.234200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.234548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.234886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] PATH_INFO: `/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.256502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2259ec42c44a06a041b731d7071399, user_id=e4a2d03404b14cd28c2051007b285d21, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.286517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.323304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1132/2248] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:36 2021] PUT /identity/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:36.328146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.338485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2f589c-cc93-4f56-8a6a-d2c18730c6f2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.404999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.405683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.406060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.406513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.407299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.436768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.447932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1117/2249] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:36 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:36.452524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.465951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc5c6b-9cec-474a-b441-176d7333ec1b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.470784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.471694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.472031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.472407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] PATH_INFO: `/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.474543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2259ec42c44a06a041b731d7071399, user_id=e4a2d03404b14cd28c2051007b285d21, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.506523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.517891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1133/2250] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:36 2021] PUT /identity/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:36.522177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.532458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a2e69-83eb-4c57-b52e-6699a65b310d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.602549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.603357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.603788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.604208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.605622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.634550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fedad-b22a-4556-a1fb-8143f1884858 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.649434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1118/2251] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:36 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:36.651748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.664254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab2f73-29a4-4c59-9617-a0a66e1eabd2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.670141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.671876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.672389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.672798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] PATH_INFO: `/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.675050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2259ec42c44a06a041b731d7071399, user_id=e4a2d03404b14cd28c2051007b285d21, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:36.706666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:36.754482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1134/2252] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:36 2021] PUT /identity/v3/projects/fe2259ec42c44a06a041b731d7071399/users/e4a2d03404b14cd28c2051007b285d21/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:36.766099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.766452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.766795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.807086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] MFA Rules not processed for user `e4a2d03404b14cd28c2051007b285d21`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:36.808471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:36.889910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1119/2253] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:36 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:36.900314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:36.904891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:36.971913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef68d5-258e-46b4-b495-8039715778e2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:36.975763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:36.976431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:36.976839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:36.977251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:36.987665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:37.015964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:37.026519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1135/2254] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:36 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:37.404563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:37.406068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:37.507665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eedcd-a194-4b56-a18b-ddc721feb8d5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:37.519985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:37.521014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:37.521442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:37.521911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] PATH_INFO: `/v3/users/4be5e1946212490d9fc196b6470c30db` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:37.525590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be5e1946212490d9fc196b6470c30db)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:37.572829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:37.632703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:37.645239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577004b-3027-44d3-a600-0d9b200db2a1 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:37.652047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:37.653007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:37.653265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:37.653601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] PATH_INFO: `/v3/users/392c9946af2e42fe9b6cbd4b18d41e89` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:37.655054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392c9946af2e42fe9b6cbd4b18d41e89)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:37.676444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be5e1946212490d9fc196b6470c30db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.685274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be5e1946212490d9fc196b6470c30db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.690447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:37.732788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be5e1946212490d9fc196b6470c30db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.734544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be5e1946212490d9fc196b6470c30db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.751330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f305de9e-5fc9-4b06-9dc1-205ab6333e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be5e1946212490d9fc196b6470c30db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.758705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1120/2255] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:37 2021] DELETE /identity/v3/users/4be5e1946212490d9fc196b6470c30db => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:37.764360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:37.765131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:37.765904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:37.789574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:37.790879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:37.863607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392c9946af2e42fe9b6cbd4b18d41e89'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.873282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392c9946af2e42fe9b6cbd4b18d41e89'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.905251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1121/2256] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:37.910438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392c9946af2e42fe9b6cbd4b18d41e89'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.911132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392c9946af2e42fe9b6cbd4b18d41e89'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.916449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:37.919180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:37.932785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bd8d042a-d313-4dee-966e-68b0f96e5498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392c9946af2e42fe9b6cbd4b18d41e89'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:37.957315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1136/2257] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:37 2021] DELETE /identity/v3/users/392c9946af2e42fe9b6cbd4b18d41e89 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:37.962579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:37.963059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:37.963939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:37.992094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:37.993711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:38.041970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708852-c0d7-4003-9ea6-59827954c5f3 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:38.081122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1137/2258] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:38.096165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:38.097964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:38.138650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:38.141110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:38.141110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:38.141110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:38.142183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:38.155688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:38.184920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:38.196715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1122/2259] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:38.276698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef4807-a3c5-44da-89c1-49c3b206304c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:38.282312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:38.283105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:38.284289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:38.285113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:38.298953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:38.330143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:38.340918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1138/2260] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:38.803932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:38.805564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:38.818492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21026f5d-3bf4-4503-a106-7eee9a9d5678 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:38.824340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:38.825902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:38.826475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:38.827257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] PATH_INFO: `/v3/projects/fa8ad18d8f9245859d063ef1f509ec3b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:38.829218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8ad18d8f9245859d063ef1f509ec3b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:38.860234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:38.883148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:38.884642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:38.903369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b82b7c-6262-4a9b-a7fc-cb0cfa76c54e service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:38.908724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:38.909023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:38.909666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:38.910043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] PATH_INFO: `/v3/projects/609cfb1b5c2b4b51944f5c0839be3a00` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:38.911275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] RBAC: Authorizing `identity:delete_project(project_id=609cfb1b5c2b4b51944f5c0839be3a00)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:38.940517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:38.988620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8ad18d8f9245859d063ef1f509ec3b', 'request_id': 'req-fc96a84d-6c94-47c0-a787-038dd10baa0c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:38.994047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8ad18d8f9245859d063ef1f509ec3b', 'request_id': 'req-fc96a84d-6c94-47c0-a787-038dd10baa0c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.039616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8ad18d8f9245859d063ef1f509ec3b', 'request_id': 'req-fc96a84d-6c94-47c0-a787-038dd10baa0c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.041024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609cfb1b5c2b4b51944f5c0839be3a00', 'request_id': 'req-54a92d65-b5f2-444b-a6cc-07fe3d67547d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.048452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609cfb1b5c2b4b51944f5c0839be3a00', 'request_id': 'req-54a92d65-b5f2-444b-a6cc-07fe3d67547d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.074567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] The token cache is being invalidate because project fa8ad18d8f9245859d063ef1f509ec3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:39.077093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.077093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-fc96a84d-6c94-47c0-a787-038dd10baa0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.077604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1123/2261] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:38 2021] DELETE /identity/v3/projects/fa8ad18d8f9245859d063ef1f509ec3b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:39.083211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bbd3-8278-485d-af56-ccb02dedacf8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.083633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bbd3-8278-485d-af56-ccb02dedacf8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.084082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419bbd3-8278-485d-af56-ccb02dedacf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.094959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609cfb1b5c2b4b51944f5c0839be3a00', 'request_id': 'req-54a92d65-b5f2-444b-a6cc-07fe3d67547d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.117178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] The token cache is being invalidate because project 609cfb1b5c2b4b51944f5c0839be3a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:39.117517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.118241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.120061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1139/2262] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:38 2021] DELETE /identity/v3/projects/609cfb1b5c2b4b51944f5c0839be3a00 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:39.126585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0419bbd3-8278-485d-af56-ccb02dedacf8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:39.126746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.128358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0419bbd3-8278-485d-af56-ccb02dedacf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:39.128800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:39.231940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1124/2263] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:39.234354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92d65-b5f2-444b-a6cc-07fe3d67547d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.243959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.244108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.244503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.249136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.249244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.249323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.249323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] PATH_INFO: `/v3/users/e4a2d03404b14cd28c2051007b285d21` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.249323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a2d03404b14cd28c2051007b285d21)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.273701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:39.275300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:39.276295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.290838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1125/2264] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:39.293993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.310011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1083-25fd-42c8-a9f9-857d0de6e819 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.310011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.310680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.311020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.311357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.312149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:39.312504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.341522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.356749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1126/2265] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:28:39.361423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.371373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc24f73-932b-4e98-96fd-634a58b0372d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.376044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.376694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.377037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.377372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.378140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.401014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a2d03404b14cd28c2051007b285d21'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.408318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.410164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a2d03404b14cd28c2051007b285d21'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.449420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a2d03404b14cd28c2051007b285d21'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.450117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a2d03404b14cd28c2051007b285d21'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.463087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a2d03404b14cd28c2051007b285d21'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:39.470535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1140/2266] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:39 2021] DELETE /identity/v3/users/e4a2d03404b14cd28c2051007b285d21 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:39.488923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1127/2267] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:39 2021] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:39.490219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.491690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:39.567633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb419698-793e-4817-87a8-fff6816dfae4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.633059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.633746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.634134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.634466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.635188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.664896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.712608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1141/2268] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:39 2021] POST /identity/v3/users => generated 280 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:39.717072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.727479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404633-9df9-4566-beac-066081c10ef0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.732839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.733522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.733984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.734332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.735173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.763936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.775629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1128/2269] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:39 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:39.781176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.792182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8b23-568b-46fe-bfd6-8b009b061f3d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:39.797943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:39.798994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:39.799494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:39.799834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] PATH_INFO: `/v3/projects/31e32798a5554bac9314a5dffc31d762/users/6f818bde336749ddaaab4fb1b57b730b/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:39.830980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e32798a5554bac9314a5dffc31d762, user_id=6f818bde336749ddaaab4fb1b57b730b, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:39.874119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7803a-68fe-4835-a451-6ec3ec519700 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:39.972469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:39.979534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.002189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1142/2270] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:39 2021] PUT /identity/v3/projects/31e32798a5554bac9314a5dffc31d762/users/6f818bde336749ddaaab4fb1b57b730b/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:40.003906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba53771-4743-46e5-9f49-db81a02e8757 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.004425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba53771-4743-46e5-9f49-db81a02e8757 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.004771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba53771-4743-46e5-9f49-db81a02e8757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.008529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfc0d-a31d-4af5-b183-689ad6fc7c9f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.081085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-dba53771-4743-46e5-9f49-db81a02e8757 None None] MFA Rules not processed for user `6f818bde336749ddaaab4fb1b57b730b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:40.082416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dba53771-4743-46e5-9f49-db81a02e8757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.117965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.119253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.119596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.119910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] PATH_INFO: `/v3/projects/fe2259ec42c44a06a041b731d7071399` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.122488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2259ec42c44a06a041b731d7071399)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.153334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.175711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1143/2271] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/auth/tokens => generated 3666 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:40.207290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb795-bde1-49a1-83e0-5ef552fd9da0 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.207684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb795-bde1-49a1-83e0-5ef552fd9da0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.208073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fb795-bde1-49a1-83e0-5ef552fd9da0 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.209924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1144/2272] 10.222.0.18 () {54 vars in 950 bytes} [Sat Aug 21 12:28:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 12:28:40.215418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.215756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.218619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.239907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] MFA Rules not processed for user `8c3cbfabf9954b87b9a13bf68684d0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:40.241301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.256570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2259ec42c44a06a041b731d7071399', 'request_id': 'req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.263954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2259ec42c44a06a041b731d7071399', 'request_id': 'req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.299506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2259ec42c44a06a041b731d7071399', 'request_id': 'req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.307084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1145/2273] 10.222.0.18 () {58 vars in 1048 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:40.317869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.318123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] The token cache is being invalidate because project fe2259ec42c44a06a041b731d7071399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:40.320126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.320126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-260e86c0-2985-4672-8ad9-0dc7a6fc04c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.320831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1129/2274] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:39 2021] DELETE /identity/v3/projects/fe2259ec42c44a06a041b731d7071399 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:40.326898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9884f-cc8c-443e-8a71-5edc59bdaf49 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.327223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abb6f3-0ea7-4a8c-9fa9-5af6076173d3 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.327568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abb6f3-0ea7-4a8c-9fa9-5af6076173d3 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.327903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abb6f3-0ea7-4a8c-9fa9-5af6076173d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.330641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.331297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.331639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.331970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.333804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.352233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b1abb6f3-0ea7-4a8c-9fa9-5af6076173d3 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:40.353449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b1abb6f3-0ea7-4a8c-9fa9-5af6076173d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.413158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.426695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1130/2275] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:40.434812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.435159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.435490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.452632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.470042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:40.471270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.480169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1131/2276] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:40.480535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1146/2277] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:40 2021] GET /identity/v3/auth/tokens => generated 3666 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:40.484910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.496190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f82d-1b75-41a0-bef7-dc4e3eb88eca None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.500545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.501204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.501546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.501908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.502699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:40.503051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.533935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.549431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1132/2278] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:40.556309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.569174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfdfa7-918f-497c-9a36-5d66c1a956d9 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.581592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.582474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.582907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.583348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.584386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.613954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.667169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1147/2279] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:40.671950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.683553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17eb7-845e-4b3c-a7f4-7575c5bdf382 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.751010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.751688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.752036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.752366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.753084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.782519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.795501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.797317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:40.809733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f6f3c-d74e-415f-a4b8-0a7b13095b40 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.814457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.815346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.815687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.816019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] PATH_INFO: `/v3/users/6f818bde336749ddaaab4fb1b57b730b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.817317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f818bde336749ddaaab4fb1b57b730b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.830962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1133/2280] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:40 2021] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:40.835114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.845850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ee07f-6804-4b33-bd62-55e384cc5b83 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.846610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.850535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.851198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.851543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.851880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.852666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.881647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.893628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1134/2281] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:40 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:40.898008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:40.908401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3aad-115a-4406-9cd6-161165eedf08 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:40.913481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:40.914453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:40.914788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:40.915129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] PATH_INFO: `/v3/projects/c9b08274406047c887a02cefff2a9258/users/59fe5e7053f44b6a8b8bf496795ec3bd/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:40.937433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b08274406047c887a02cefff2a9258, user_id=59fe5e7053f44b6a8b8bf496795ec3bd, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:40.942572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f818bde336749ddaaab4fb1b57b730b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.951324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f818bde336749ddaaab4fb1b57b730b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.968105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2c13f-8b2d-4b3f-af68-0e19da1ffeff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:40.991523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f818bde336749ddaaab4fb1b57b730b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:40.992214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f818bde336749ddaaab4fb1b57b730b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.004797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-769822ae-a0b2-434e-924d-0c405474e2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f818bde336749ddaaab4fb1b57b730b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.011641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1148/2282] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:40 2021] DELETE /identity/v3/users/6f818bde336749ddaaab4fb1b57b730b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:41.016459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.016773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.017109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.027701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1135/2283] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:40 2021] PUT /identity/v3/projects/c9b08274406047c887a02cefff2a9258/users/59fe5e7053f44b6a8b8bf496795ec3bd/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:41.039705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.040077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.040416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.041752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:41.043111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:41.078535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] MFA Rules not processed for user `59fe5e7053f44b6a8b8bf496795ec3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:41.079750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:41.113640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1149/2284] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:41.125187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.126793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:41.161029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1136/2285] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:41 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:41.166290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.167835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:41.181710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f7c20-1d76-4e21-ba78-0fc02f79f3e1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.187152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.187813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.188131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.188455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.189188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.200866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3650-8d94-4b9f-b3eb-44b47b1f883e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.204599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.205259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.205600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.206390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.217624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.218639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.246387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.256794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1150/2286] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:41.279946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1137/2287] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:41 2021] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:41.284625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.295340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03a8b6-7eac-49ba-acc0-2e0a76fc2a15 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.369164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.369894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.370247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.371200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.371938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.401223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.461837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1151/2288] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:41 2021] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:41.466199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.476711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce76500-2715-464b-9799-53f44f76e309 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.481691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.482407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.482747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.483076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.483867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.514549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.526132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1138/2289] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:41.531091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.541952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029106e-c467-4de8-a8e2-4a1037581b07 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.547211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.548261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.548603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.548941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] PATH_INFO: `/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.570794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e75292fb6d4f44929aab19ca8da306, user_id=fa427612ad744a95837a51e422684cb7, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.601148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.639265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1152/2290] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:41 2021] PUT /identity/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:41.643643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.654587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385b16b-293f-4dd1-9302-2d37db1eeb4d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.702283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.704028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:41.733183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.734059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.734401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.734736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.735517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.764012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.778834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1139/2291] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:41.779794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c2dd-481c-40ef-b7b5-7079ad0cb96d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.779936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.784720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.785547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.785929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.786265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] PATH_INFO: `/v3/projects/31e32798a5554bac9314a5dffc31d762` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.787484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e32798a5554bac9314a5dffc31d762)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.790110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4f70-930d-4e7e-864f-1b284687355c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.794869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.795756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.796098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.796543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] PATH_INFO: `/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.798555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e75292fb6d4f44929aab19ca8da306, user_id=fa427612ad744a95837a51e422684cb7, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:41.815716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.828161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:41.839023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1140/2292] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:41 2021] PUT /identity/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:41.843734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:41.888555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e32798a5554bac9314a5dffc31d762', 'request_id': 'req-6611d40a-1b6c-4724-831c-bf1a9a206975'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.893900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e32798a5554bac9314a5dffc31d762', 'request_id': 'req-6611d40a-1b6c-4724-831c-bf1a9a206975'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.916892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6012c9c-d7d1-419c-9ed3-b96ba0e1aad6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:41.928942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e32798a5554bac9314a5dffc31d762', 'request_id': 'req-6611d40a-1b6c-4724-831c-bf1a9a206975'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.966423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] The token cache is being invalidate because project 31e32798a5554bac9314a5dffc31d762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:41.966754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.968015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6611d40a-1b6c-4724-831c-bf1a9a206975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:41.970144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1153/2293] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:41 2021] DELETE /identity/v3/projects/31e32798a5554bac9314a5dffc31d762 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:41.976177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d702-c83e-4ece-9776-cf74f55ad80f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.976947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d702-c83e-4ece-9776-cf74f55ad80f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.976947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1d702-c83e-4ece-9776-cf74f55ad80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.988989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:41.989781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:41.990256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:41.990684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:41.991571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.002991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-18b1d702-c83e-4ece-9776-cf74f55ad80f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:42.004286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-18b1d702-c83e-4ece-9776-cf74f55ad80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.015954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1154/2294] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:42.021514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.021825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.021933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.022376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.034822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1141/2295] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:41 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:42.038904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.040638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.047846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:42.049026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.053367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4698d-ea7f-4a4f-b821-cc3dbfd994d0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.056526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1155/2296] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:42.059974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.059974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.059974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.060359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] PATH_INFO: `/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.060846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.061480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e75292fb6d4f44929aab19ca8da306, user_id=fa427612ad744a95837a51e422684cb7, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.069737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ef3c3-ec32-488d-97c9-486ffb00319f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.074697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.075425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.075848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.076266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.077117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:42.077465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.090995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c263-3bb5-43b7-8106-32ddca89d1ec admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.106418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.121505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1156/2297] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:42.126287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.129321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1142/2298] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:42 2021] PUT /identity/v3/projects/05e75292fb6d4f44929aab19ca8da306/users/fa427612ad744a95837a51e422684cb7/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:42.138032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfcc10-5352-49bd-be7c-a9fe01525c97 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.139747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.140093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.140432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.179074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] MFA Rules not processed for user `fa427612ad744a95837a51e422684cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:42.180300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.203733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.204406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.204742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.205073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.205820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.234442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.285108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1157/2299] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:42.287245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1143/2300] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:42.289295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.298597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.300085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.365035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d1765-1add-4131-9919-eb9227f3a647 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.370169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.371374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.371716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.372048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.372808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.402047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.443432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1be845-ddf4-4575-abbe-403122873e16 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.449546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1158/2301] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:42.453655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.463321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afab9-bde7-481d-8a3e-634921ec50cc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.467943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.468597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.468934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.469268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.470093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.499800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.503803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.504492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.504846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.505179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.514267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1159/2302] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:42 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:42.515357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.525461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c08726-0b7c-48c7-bf71-a015f74e1ed1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.530309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.531206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.531550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.531894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] PATH_INFO: `/v3/projects/e8089745c5054dcf8e83898ca3d24513/users/01ac8b37840344a38e07efacf984aa87/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.555862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8089745c5054dcf8e83898ca3d24513, user_id=01ac8b37840344a38e07efacf984aa87, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.586032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a4835-9c87-4236-9291-f947bb72b5a6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.599594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.628588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.631348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1160/2303] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:42 2021] PUT /identity/v3/projects/e8089745c5054dcf8e83898ca3d24513/users/01ac8b37840344a38e07efacf984aa87/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:42.639459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1144/2304] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:42 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:42.642012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.642490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.643001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.698429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] MFA Rules not processed for user `01ac8b37840344a38e07efacf984aa87`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:42.698429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.752489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.771505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428318a-d040-4ac6-924e-2301e8ca1e17 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.787959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1161/2305] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:42.793309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:42.843634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.844257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.844589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.844919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.846814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:42.869151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781ae9d-4c88-4fbe-b07d-028f7c734b9c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:42.874197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:42.875078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:42.875603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:42.876153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:42.876889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.907269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.918034 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:42.946691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:42.957437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1145/2306] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:42 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:43.046219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1162/2307] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:42 2021] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:43.050412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.061931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0656d78-83ac-4972-b4e3-1a1ff411d814 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.130469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.131160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.131553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.131891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.132691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.164186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.182724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.193398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0c357-227d-46b5-aaf8-aa4103f17e43 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.207319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.207319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.207319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.207319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] PATH_INFO: `/v3/users/59fe5e7053f44b6a8b8bf496795ec3bd` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.207754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fe5e7053f44b6a8b8bf496795ec3bd)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.230741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.235403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1146/2308] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:43 2021] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:43.238859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.249222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a71b-6f82-49e1-b37a-f364f5f5764f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.254319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.255214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.255717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.256207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.257167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.287514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.299887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1147/2309] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:43 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:43.303885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.314413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769120-686d-44c1-89e2-22ec5a292058 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.319071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.319940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.320274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.320604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] PATH_INFO: `/v3/projects/ae5e5b9262be45b38f7dd92128b9d9ab/users/98196d3e20034b2da650a638446b87f2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.342695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5e5b9262be45b38f7dd92128b9d9ab, user_id=98196d3e20034b2da650a638446b87f2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.358902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fe5e7053f44b6a8b8bf496795ec3bd'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:43.367432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fe5e7053f44b6a8b8bf496795ec3bd'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:43.372922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48631458-dbe9-4234-8d26-9c726628e626 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.395698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fe5e7053f44b6a8b8bf496795ec3bd'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:43.396363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fe5e7053f44b6a8b8bf496795ec3bd'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:43.410228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2dbe4d99-bb1e-4fb5-b401-2b34aa93eb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fe5e7053f44b6a8b8bf496795ec3bd'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:43.416598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1163/2310] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:43 2021] DELETE /identity/v3/users/59fe5e7053f44b6a8b8bf496795ec3bd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:43.421165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.421516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.421885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.424812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1148/2311] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:43 2021] PUT /identity/v3/projects/ae5e5b9262be45b38f7dd92128b9d9ab/users/98196d3e20034b2da650a638446b87f2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:43.434975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.435332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.435665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.444451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:43.445678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:43.473674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] MFA Rules not processed for user `98196d3e20034b2da650a638446b87f2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:43.474908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:43.519709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1164/2312] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:43.527786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.529150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:43.552251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1149/2313] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:43 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:43.556633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.558791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:43.571174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a781350-fd98-45a0-8f9f-7440b1bbb953 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.576429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.577182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.577527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.577881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.578617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.596511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555ce76-6ed9-44c9-b892-9d7637eac45d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.600880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.601850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.602407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.602873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.607125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.613688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.643484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.658300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1165/2314] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:43.691544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1150/2315] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:43 2021] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:43.695756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.707364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7a19-e007-41d1-b8ff-9c46b3afab6b service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.810839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.810839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.811226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.811721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.812675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:43.869547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:43.939552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1166/2316] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:43 2021] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:43.947480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:43.961377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162e840-5519-4c0b-9580-807bebf69f41 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:43.967785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:43.968751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:43.969102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:43.969437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:43.970982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.009850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.026214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1151/2317] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:43 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:44.031197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.060512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf886d-5e48-4450-a4e6-13b31e6b62d4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.076412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.077359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.077704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.078067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] PATH_INFO: `/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.127771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1232b83913f423c8cee44c2cfd06f98, user_id=22493f67b8924964980a8114d54264c6, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.162156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.208880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1167/2318] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:44 2021] PUT /identity/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:44.213133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.226902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186e63-cba9-4a4c-9c48-795e7bd4bc74 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.311079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.312002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.312414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.312864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.313735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.345831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.361048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1152/2319] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:44 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:44.367219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.381246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2014a-83af-4d20-bba9-a7c484bbc44b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.382065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.383957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:44.387386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.388675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.389018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.389359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] PATH_INFO: `/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.391571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1232b83913f423c8cee44c2cfd06f98, user_id=22493f67b8924964980a8114d54264c6, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.398769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ccde2-34b9-4116-a717-26d3d3d1f84d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.404309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.405353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.405828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.406358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] PATH_INFO: `/v3/projects/c9b08274406047c887a02cefff2a9258` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.407754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b08274406047c887a02cefff2a9258)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.426484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.440512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1168/2320] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:44 2021] PUT /identity/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:44.442037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.443530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.530260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07eed5-0657-46eb-b878-2b536cd234b2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.536744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b08274406047c887a02cefff2a9258', 'request_id': 'req-6a7da1cc-047a-43c3-91b9-fd79204f2198'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.542030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b08274406047c887a02cefff2a9258', 'request_id': 'req-6a7da1cc-047a-43c3-91b9-fd79204f2198'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.598928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.599615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.600047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.600384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.601208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.607144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b08274406047c887a02cefff2a9258', 'request_id': 'req-6a7da1cc-047a-43c3-91b9-fd79204f2198'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.627080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] The token cache is being invalidate because project c9b08274406047c887a02cefff2a9258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:44.627503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.628419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.630576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1153/2321] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:44 2021] DELETE /identity/v3/projects/c9b08274406047c887a02cefff2a9258 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:44.630994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.641634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.643327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:44.643910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1169/2322] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:44 2021] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:44.648672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.652742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:44.661782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da1cc-047a-43c3-91b9-fd79204f2198 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.667281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.667434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fdef1-9ebf-472c-8a7e-f23284a2bd09 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.668324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.668812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.669233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] PATH_INFO: `/v3/users/fa427612ad744a95837a51e422684cb7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.670537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa427612ad744a95837a51e422684cb7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.673632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.674800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.677999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.677999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] PATH_INFO: `/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.686118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1232b83913f423c8cee44c2cfd06f98, user_id=22493f67b8924964980a8114d54264c6, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:44.703254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.722929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bd27b-ba1b-4420-af0b-1ee49af5afda admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:44.762937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1170/2323] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:44 2021] PUT /identity/v3/projects/c1232b83913f423c8cee44c2cfd06f98/users/22493f67b8924964980a8114d54264c6/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:44.774995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.775339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.775672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.813877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] MFA Rules not processed for user `22493f67b8924964980a8114d54264c6`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:44.815087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:44.820988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa427612ad744a95837a51e422684cb7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.829798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa427612ad744a95837a51e422684cb7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.864138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa427612ad744a95837a51e422684cb7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.864790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa427612ad744a95837a51e422684cb7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.877953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa427612ad744a95837a51e422684cb7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:44.884497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1154/2324] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:44 2021] DELETE /identity/v3/users/fa427612ad744a95837a51e422684cb7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:44.897098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1171/2325] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:44 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:44.908337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:44.910021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:44.991088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaed92a-15a1-4ae6-ac94-5707d397a41d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:44.995027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:44.996332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:44.996759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:44.997169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:44.999321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:45.086286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:45.124464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15a885-867b-46ac-b4f5-1815e6c6a20a service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:45.136361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1155/2326] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:44 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:45.362566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:45.364035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:45.441528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220ef33-4a12-461e-a84e-6fab5a86f7e4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:45.516443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:45.517335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:45.517673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:45.518040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] PATH_INFO: `/v3/projects/05e75292fb6d4f44929aab19ca8da306` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:45.519313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e75292fb6d4f44929aab19ca8da306)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:45.549138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:45.663917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e75292fb6d4f44929aab19ca8da306', 'request_id': 'req-7e4028e4-79c7-4319-8511-12f28f73f160'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:45.683971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e75292fb6d4f44929aab19ca8da306', 'request_id': 'req-7e4028e4-79c7-4319-8511-12f28f73f160'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:45.728723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e75292fb6d4f44929aab19ca8da306', 'request_id': 'req-7e4028e4-79c7-4319-8511-12f28f73f160'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:45.751984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] The token cache is being invalidate because project 05e75292fb6d4f44929aab19ca8da306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:45.752322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:45.753011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7e4028e4-79c7-4319-8511-12f28f73f160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:45.754661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1172/2327] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:45 2021] DELETE /identity/v3/projects/05e75292fb6d4f44929aab19ca8da306 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:45.764761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:45.765470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:45.766049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:45.809776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:45.811163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:45.897462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1156/2328] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:45.906712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:45.907160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:45.907552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:45.934514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:45.935869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:45.943552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1173/2329] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:45.948211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:45.959068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf06d-3f66-4fb6-b66a-7a44acba2c10 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:45.963791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:45.965029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:45.965941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:45.966075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:45.966814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:45.967174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:45.996657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.015809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1157/2330] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:46.017532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.028495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe9e45-b68b-439a-915e-7ee795dca901 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.033246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.034020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.034684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.035083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.035882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.071843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.153904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1174/2331] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:46 2021] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:46.158564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.169955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57130d-1c6a-4107-b89b-6e8a9b18e503 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.255669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.256590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.257128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.257589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.258762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.288534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.350488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1158/2332] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:46 2021] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:46.355326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.367844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb209-45b6-449e-ac14-7da7e7933662 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.375448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.376513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.376857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.377193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.378025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.408142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21388bd0-edae-4686-8dca-5d220ac4f90f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.424297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1175/2333] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:46 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:46.425936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.446362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26c63-6101-4d83-bc5e-b646d6331cc7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.453129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.454073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.454795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.455181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] PATH_INFO: `/v3/projects/e1fa186996244cee8cacdb33875babf1/users/5a06eed8f2c14bae92ddd44ac02e7114/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.479514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fa186996244cee8cacdb33875babf1, user_id=5a06eed8f2c14bae92ddd44ac02e7114, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.511896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.559904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1159/2334] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:46 2021] PUT /identity/v3/projects/e1fa186996244cee8cacdb33875babf1/users/5a06eed8f2c14bae92ddd44ac02e7114/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:46.565297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.565643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.566050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.601719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:46.602989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:46.673244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1176/2335] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:46.684874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.686867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:46.764553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e8590-80e4-46df-8dfb-f1cbd8ff4905 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.768823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.769744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.770197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.770607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.781810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.811890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddc6c4-940c-433c-9f96-ed84827c5ac0 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:46.823111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1160/2336] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:46.861529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:46.863207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:46.875267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c6001-097a-4d5c-a25e-47743be5265f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:46.880028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:46.881161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:46.881512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:46.881873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] PATH_INFO: `/v3/users/894c26024d8c46be8d3ccdc21a8c0bb2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:46.883120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] RBAC: Authorizing `identity:delete_user(user_id=894c26024d8c46be8d3ccdc21a8c0bb2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:46.913108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:47.035159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894c26024d8c46be8d3ccdc21a8c0bb2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:47.044641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894c26024d8c46be8d3ccdc21a8c0bb2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:47.077338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894c26024d8c46be8d3ccdc21a8c0bb2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:47.078070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894c26024d8c46be8d3ccdc21a8c0bb2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:47.091806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894c26024d8c46be8d3ccdc21a8c0bb2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:47.098397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1177/2337] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:46 2021] DELETE /identity/v3/users/894c26024d8c46be8d3ccdc21a8c0bb2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:47.103416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:47.106541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:47.106541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:47.129181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:47.130464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:47.206865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1161/2338] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:47.217752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:47.219243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:47.268023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:47.269454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:47.293125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262867eb-0071-49fb-8ceb-878441a8758b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:47.297079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:47.297978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:47.298428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:47.298982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:47.312003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:47.342367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6df51-5cd5-4f9c-9693-f4c8220d52db None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:47.342734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:47.346114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:47.346772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:47.347226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:47.347428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:47.350978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:47.355850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1178/2339] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:47.428966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:47.461879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:47.473444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1162/2340] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:47 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:47.957863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:47.959925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:47.980538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81491233-56e1-4e5b-a389-b5275cf27757 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:47.986988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:47.987901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:47.988228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:47.988560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] PATH_INFO: `/v3/projects/55b14234ca4645358b79aa94eae6a25c` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:47.990314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b14234ca4645358b79aa94eae6a25c)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:48.040645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:48.146788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b14234ca4645358b79aa94eae6a25c', 'request_id': 'req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.153376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b14234ca4645358b79aa94eae6a25c', 'request_id': 'req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.191738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b14234ca4645358b79aa94eae6a25c', 'request_id': 'req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.209978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] The token cache is being invalidate because project 55b14234ca4645358b79aa94eae6a25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:48.210370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.211059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5eb14286-c97c-46e1-9da8-5efdf21d2f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.212620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1179/2341] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:47 2021] DELETE /identity/v3/projects/55b14234ca4645358b79aa94eae6a25c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:48.217391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:48.228771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da786c7d-808f-460f-bf2b-40877d4b1981 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:48.307019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:48.309121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:48.309822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:48.310345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] PATH_INFO: `/v3/users/76355b4eb9af48a18fd9b890722e398b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:48.314802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76355b4eb9af48a18fd9b890722e398b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:48.368327 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:48.418879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:48.419229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:48.419567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:48.463778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] MFA Rules not processed for user `5a06eed8f2c14bae92ddd44ac02e7114`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:48.465251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:48.529494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76355b4eb9af48a18fd9b890722e398b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.540098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76355b4eb9af48a18fd9b890722e398b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.576123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76355b4eb9af48a18fd9b890722e398b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.576971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76355b4eb9af48a18fd9b890722e398b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.623455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76355b4eb9af48a18fd9b890722e398b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:48.623604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1180/2342] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:48 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:48.626767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1163/2343] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:48 2021] DELETE /identity/v3/users/76355b4eb9af48a18fd9b890722e398b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:48.743261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:48.745205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:48.829801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf1b4-41f6-4cc5-b3e4-3e90ec02ebdf None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:48.892683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:48.893839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:48.894335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:48.894806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:48.985668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.018714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693fbf-1c5a-485e-a87b-6f540ba3f5c2 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:49.031186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1181/2344] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:48 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:49.248185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:49.249886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.350544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a93c41-8970-4f4f-a62b-61fad77d2204 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:49.356081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:49.357156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.357495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.357867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] PATH_INFO: `/v3/projects/2d5a8d798d084829b5b311da72a76054` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.359126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5a8d798d084829b5b311da72a76054)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.389432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:49.472056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5a8d798d084829b5b311da72a76054', 'request_id': 'req-6ccb0429-1951-4262-b3a2-54b0c3e888b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:49.477396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5a8d798d084829b5b311da72a76054', 'request_id': 'req-6ccb0429-1951-4262-b3a2-54b0c3e888b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:49.515991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5a8d798d084829b5b311da72a76054', 'request_id': 'req-6ccb0429-1951-4262-b3a2-54b0c3e888b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:49.539536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] The token cache is being invalidate because project 2d5a8d798d084829b5b311da72a76054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:49.539860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:49.540566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:49.551394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1164/2345] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:49 2021] DELETE /identity/v3/projects/2d5a8d798d084829b5b311da72a76054 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:49.557714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80316-ff71-4770-88d0-956c3af65eb9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.557714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80316-ff71-4770-88d0-956c3af65eb9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.558269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80316-ff71-4770-88d0-956c3af65eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.580555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:49.581980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.596083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4eb80316-ff71-4770-88d0-956c3af65eb9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:49.597570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4eb80316-ff71-4770-88d0-956c3af65eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.680144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb0429-1951-4262-b3a2-54b0c3e888b9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:49.684827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:49.685636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.686055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.686455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.688543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.701328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1182/2346] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:49.710439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.710898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.711330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.743653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:49.746259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.758266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1183/2347] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:49.762833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:49.775762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b9ce2-4bd6-4e8b-8c6f-999d16279087 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:49.777192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.797404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:49.799273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.801978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.802483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.803399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:49.805487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.812200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:49.822469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1165/2348] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:49 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:49.853025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:49.854593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:49.874084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:49.876376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199c182-5a6e-4c64-a2fd-97b53276e3b0 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:49.888008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:49.888962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.889306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.889672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] PATH_INFO: `/v3/users/e439555e40484f6ba4d8d4f1bb9559b9` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.890918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e439555e40484f6ba4d8d4f1bb9559b9)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.900374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1184/2349] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:28:49.905461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:49.919057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83c8d9-bdd4-4eca-9eaf-047e50928fef admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:49.922590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:49.923481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:49.923904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:49.924323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:49.925405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:49.957042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:49.963915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.057114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1185/2350] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:49 2021] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:50.061693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.133696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e439555e40484f6ba4d8d4f1bb9559b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:50.146035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad39ee-2693-4472-96b7-66ad384bac13 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.146972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e439555e40484f6ba4d8d4f1bb9559b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:50.160212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.161162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.161661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.162041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.162777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.192532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.201509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e439555e40484f6ba4d8d4f1bb9559b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:50.202210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e439555e40484f6ba4d8d4f1bb9559b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:50.215884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c95c3c0-0693-491f-8f8f-6f354e3b5202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e439555e40484f6ba4d8d4f1bb9559b9'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:50.222246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1166/2351] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:49 2021] DELETE /identity/v3/users/e439555e40484f6ba4d8d4f1bb9559b9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:50.226835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.227187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.227531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.250906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:50.252126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:50.258424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1186/2352] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:50.259530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.261724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:50.273434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff21f3-0b2f-42d5-8552-6f4e66e7dc68 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.321199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1167/2353] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:50.331933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.333321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:50.342390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.343080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.343422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.343755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.344544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.373490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.388083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1187/2354] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:50 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:50.389216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.399245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f2907-c96a-4f12-914d-6224878e7c60 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.402501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4f5e5-c087-40a6-8775-1af7371c0d4e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.404883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.406000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.406348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.406751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] PATH_INFO: `/v3/projects/a6cddc34ddc34368ae8ed74f23a36568/users/11f2277920ba484a8ee102c47e2f986e/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.407858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.408495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.409371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.409873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.422421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.429263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cddc34ddc34368ae8ed74f23a36568, user_id=11f2277920ba484a8ee102c47e2f986e, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.452639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcb530-2099-419f-a4a4-b3f6b4e13fe5 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.458723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.463158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1168/2355] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:50.528531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1188/2356] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:50 2021] PUT /identity/v3/projects/a6cddc34ddc34368ae8ed74f23a36568/users/11f2277920ba484a8ee102c47e2f986e/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:50.539804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.540155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.540495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.583141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] MFA Rules not processed for user `11f2277920ba484a8ee102c47e2f986e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:50.584324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:50.668968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1169/2357] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:50.673834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.753174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bf14b-8908-424b-8a7e-56b621f6fdb7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.758677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.759542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.759884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.760211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.761460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.790571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed7f7a-4c1c-405f-84bb-b02b049a445a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:50.846313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1189/2358] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:50.850815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:50.863545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1ef00-b345-4d6f-8e07-5c469466f55b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:50.902039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.902995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.903593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.935463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] MFA Rules not processed for user `5a06eed8f2c14bae92ddd44ac02e7114`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:50.936685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:50.944412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:50.945192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:50.945619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:50.946077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:50.946941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:50.981361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.037939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1190/2359] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:51.043290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.046627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1170/2360] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:50 2021] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:51.047752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.048408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:51.059822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5a6d9-4db8-4b91-8797-2e7e1f79f6d1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.063591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee54f71-ed55-46e5-aed5-3b54493132a6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.065353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.066208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.066553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.067028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.067830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.069761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.070892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.071426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.071978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] PATH_INFO: `/v3/projects/2fc34e1192564a598c55043bc4b1cd29` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.073363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc34e1192564a598c55043bc4b1cd29)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.100983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.105850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.114590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1171/2361] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:51 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:51.118985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.135967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7e64e-e5e5-4dc2-9d62-58b4c8536c7c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.143054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.143968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.144332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.144665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] PATH_INFO: `/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.177586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f88f17886c44e1e8385afde759f02f5, user_id=f5d1e5b3e513486384e927571be6a05c, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.211442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.227277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc34e1192564a598c55043bc4b1cd29', 'request_id': 'req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.242314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc34e1192564a598c55043bc4b1cd29', 'request_id': 'req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.262566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1172/2362] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:51 2021] PUT /identity/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:51.263526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.273968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc34e1192564a598c55043bc4b1cd29', 'request_id': 'req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.336546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] The token cache is being invalidate because project 2fc34e1192564a598c55043bc4b1cd29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:51.344315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.346867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.351403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1191/2363] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:51 2021] DELETE /identity/v3/projects/2fc34e1192564a598c55043bc4b1cd29 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:51.362915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.366262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:51.474243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75705f-8229-48ed-9f40-963e3d0d446d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.486060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.486681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.487022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.487355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.488313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.524267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.533203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38136fe-e20c-4a25-baa6-66bc1e6ee37f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.537756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1173/2364] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:51 2021] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:51.543024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.544551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.545439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:51.545570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.545893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.546229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] PATH_INFO: `/v3/users/a960a6cbd33d44b0b264a625d6cb20c0` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.550196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a960a6cbd33d44b0b264a625d6cb20c0)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.561235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337904-f9e0-4a4e-a53f-90a98167defa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.566895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.568259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.568770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.569250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] PATH_INFO: `/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.571457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f88f17886c44e1e8385afde759f02f5, user_id=f5d1e5b3e513486384e927571be6a05c, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.587972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.603077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.616506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1174/2365] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:51 2021] PUT /identity/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:51.622786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.714674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33951a40-0a27-40f5-afe2-5378abb5053d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.720306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.721171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.721774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.722383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.723294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.758439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.767602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a960a6cbd33d44b0b264a625d6cb20c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.773251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1175/2366] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:51 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:51.778290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:51.791061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a960a6cbd33d44b0b264a625d6cb20c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.799684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066c8fe-8e94-459f-9723-f95311a5b95c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:51.812734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:51.818150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.818150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.818150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] PATH_INFO: `/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.818150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f88f17886c44e1e8385afde759f02f5, user_id=f5d1e5b3e513486384e927571be6a05c, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:51.837264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a960a6cbd33d44b0b264a625d6cb20c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.838509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a960a6cbd33d44b0b264a625d6cb20c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.852678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:51.865016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8467204a-6da9-49f1-8274-0f068f3364e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a960a6cbd33d44b0b264a625d6cb20c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:51.879840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1192/2367] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:51 2021] DELETE /identity/v3/users/a960a6cbd33d44b0b264a625d6cb20c0 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:51.901410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1176/2368] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:51 2021] PUT /identity/v3/projects/5f88f17886c44e1e8385afde759f02f5/users/f5d1e5b3e513486384e927571be6a05c/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:51.912127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:51.912567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:51.913148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:51.984584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] MFA Rules not processed for user `f5d1e5b3e513486384e927571be6a05c`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:51.986029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:52.159965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1193/2369] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:51 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:52.175597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:52.177539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:52.292232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64363749-df06-40c9-9c9e-6014a4abbf33 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:52.292928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:52.293955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:52.294417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:52.294859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:52.308110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:52.342320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:52.369908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1177/2370] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:52 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:52.523999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:52.543237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18651fc2-4a17-4ffb-be89-9984a9db9d5f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:52.552642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:52.553359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:52.553690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:52.556754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:52.561187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:52.674163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:52.705423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c00269-d346-4831-bf85-fbf78c05fbf4 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:52.715982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1194/2371] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:52 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:53.155971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:53.157778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:53.268578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e22ef0-4540-4e7c-96de-0844fdeb821a service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:53.273844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:53.274742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:53.275084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:53.275417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] PATH_INFO: `/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:53.276744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b714f598ea74a7b84f2de58eb3e72c6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:53.321163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:53.435355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b714f598ea74a7b84f2de58eb3e72c6', 'request_id': 'req-f0f8bc61-bbcc-4250-9279-5d31333a4718'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:53.443425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b714f598ea74a7b84f2de58eb3e72c6', 'request_id': 'req-f0f8bc61-bbcc-4250-9279-5d31333a4718'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:53.501522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b714f598ea74a7b84f2de58eb3e72c6', 'request_id': 'req-f0f8bc61-bbcc-4250-9279-5d31333a4718'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:53.528464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] The token cache is being invalidate because project 8b714f598ea74a7b84f2de58eb3e72c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:53.528784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:53.530013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0f8bc61-bbcc-4250-9279-5d31333a4718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:53.531783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1178/2372] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:53 2021] DELETE /identity/v3/projects/8b714f598ea74a7b84f2de58eb3e72c6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:53.538225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:53.538650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:53.539055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:53.565835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:53.567372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:53.693410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1195/2373] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:53.702673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:53.704087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:53.704717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:53.736657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:53.738278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:53.749216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1179/2374] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:53.761751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:53.777817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4811e-91cd-4c47-a616-02e5c67f0e4b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:53.780507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:53.781417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:53.782264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:53.782264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:53.783011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:53.783428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:53.819176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:53.838434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1196/2375] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:53.840889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:53.849174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378bffc-2125-4b5a-ac09-3f4fbcd7d400 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:53.854037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:53.856065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:53.856409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:53.856744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:53.857486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:53.888445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:54.000231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1180/2376] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:53 2021] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:54.001524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:54.020822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e119-1ec6-4e19-a7d7-143a425186c3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:54.149474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a638a-f373-47d7-8410-107868199208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:54.150357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a638a-f373-47d7-8410-107868199208 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.150762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a638a-f373-47d7-8410-107868199208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.151134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a638a-f373-47d7-8410-107868199208 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.152286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a638a-f373-47d7-8410-107868199208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:54.185288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a638a-f373-47d7-8410-107868199208 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:54.237459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1197/2377] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:53 2021] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:28:54.238925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:54.254176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8f8a2-b1fb-4418-baa0-5bae2b9bca76 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:54.271949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:54.272734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.273150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.273732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.274672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:54.337924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:54.377117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1181/2378] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:54 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:28:54.378806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a638a-f373-47d7-8410-107868199208 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:54.391800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a638a-f373-47d7-8410-107868199208 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:54.396366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:54.397285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.397628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.398138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] PATH_INFO: `/v3/projects/0b1a140e47b74e60a7de9cc3119f2cb5/users/5b0d300205994f009f421cbea7f610ca/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.422040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1a140e47b74e60a7de9cc3119f2cb5, user_id=5b0d300205994f009f421cbea7f610ca, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:54.449374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:54.451635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:54.453344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b7a0-1ce3-488e-9ce7-090103e9935d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:54.471159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bd6df-07b2-463d-a0c4-cd6dd9538b8f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:54.476345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:54.477823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.478457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.478800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] PATH_INFO: `/v3/users/ffc11be2bed145b2aa2d9d0313063c29` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.480236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc11be2bed145b2aa2d9d0313063c29)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:54.510050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1198/2379] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:54 2021] PUT /identity/v3/projects/0b1a140e47b74e60a7de9cc3119f2cb5/users/5b0d300205994f009f421cbea7f610ca/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:54.511639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:54.520914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.521338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.521675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.567328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] MFA Rules not processed for user `5b0d300205994f009f421cbea7f610ca`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:54.568707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:54.662731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc11be2bed145b2aa2d9d0313063c29'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:54.677109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc11be2bed145b2aa2d9d0313063c29'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:54.692719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1199/2380] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:54 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:28:54.706908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:54.708345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:54.734824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc11be2bed145b2aa2d9d0313063c29'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:54.735740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc11be2bed145b2aa2d9d0313063c29'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:54.756068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc11be2bed145b2aa2d9d0313063c29'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:54.763367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1182/2381] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:54 2021] DELETE /identity/v3/users/ffc11be2bed145b2aa2d9d0313063c29 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:54.801518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e914c8-28d1-4cbf-948f-024a157b76e9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:54.907010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:54.908041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:54.908605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:54.909520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:54.912668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.010238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:55.041608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:55.052597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1200/2382] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:54 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:55.093255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:55.095000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.146839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:55.148356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.211663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd3f81-3af9-4f2b-b618-c3d7836e75dd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:55.217000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:55.218227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:55.218942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:55.219392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] PATH_INFO: `/v3/users/5b0d300205994f009f421cbea7f610ca` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:55.221782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0d300205994f009f421cbea7f610ca)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:55.260563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:55.268258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bc6ea-f868-4b8f-a70f-b7f551cb5d36 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:55.296391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:55.297419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:55.297872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:55.298288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] PATH_INFO: `/v3/projects/43951e232f85445a85759063131294aa` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:55.299638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=43951e232f85445a85759063131294aa)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:55.328645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:55.432104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0d300205994f009f421cbea7f610ca'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.454787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0d300205994f009f421cbea7f610ca'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.466265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43951e232f85445a85759063131294aa', 'request_id': 'req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.477930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43951e232f85445a85759063131294aa', 'request_id': 'req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.496115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0d300205994f009f421cbea7f610ca'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.496802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0d300205994f009f421cbea7f610ca'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.512269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9752f74a-5434-4120-8b04-dbaa1aaefac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0d300205994f009f421cbea7f610ca'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.522880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1183/2383] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:55 2021] DELETE /identity/v3/users/5b0d300205994f009f421cbea7f610ca => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:55.523580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43951e232f85445a85759063131294aa', 'request_id': 'req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.527165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:55.527514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:55.527853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:55.551846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] The token cache is being invalidate because project 43951e232f85445a85759063131294aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:55.552188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.556188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.561645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1201/2384] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:55 2021] DELETE /identity/v3/projects/43951e232f85445a85759063131294aa => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:55.563728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:55.566629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.567863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:55.568985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.677412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1184/2385] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:55.678641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:55.680364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:55.691228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cd1a4-2fd8-4316-9b61-82cbcff06dfa admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:55.692328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc0cd-7df7-4232-8337-8ef83b51f1cc None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:55.696103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:55.697004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:55.697134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:55.697343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:55.697653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] PATH_INFO: `/v3/users/71e0c2d3550146c59a7b1bc5cd675689` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:55.697911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:55.698298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:55.698628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] PATH_INFO: `/v3/users/01ac8b37840344a38e07efacf984aa87` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:55.699172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e0c2d3550146c59a7b1bc5cd675689)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:55.699928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ac8b37840344a38e07efacf984aa87)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:55.729014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:55.733092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:55.921865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ac8b37840344a38e07efacf984aa87'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.932391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ac8b37840344a38e07efacf984aa87'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.933740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e0c2d3550146c59a7b1bc5cd675689'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.943290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e0c2d3550146c59a7b1bc5cd675689'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.980575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ac8b37840344a38e07efacf984aa87'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.981561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ac8b37840344a38e07efacf984aa87'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:55.996243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ac8b37840344a38e07efacf984aa87'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.002759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e0c2d3550146c59a7b1bc5cd675689'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.002969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1185/2386] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:55 2021] DELETE /identity/v3/users/01ac8b37840344a38e07efacf984aa87 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:56.003721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e0c2d3550146c59a7b1bc5cd675689'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.006839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:56.008260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.030847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-efa176f8-4577-402d-a5e5-16f132045568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e0c2d3550146c59a7b1bc5cd675689'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.043038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1202/2387] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:55 2021] DELETE /identity/v3/users/71e0c2d3550146c59a7b1bc5cd675689 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:56.045939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.046489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.046699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.075120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:56.077050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.079178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752384f-81cc-4ffd-8016-a32178f579e7 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:56.159450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:56.160492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.160840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.161181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.163129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.186711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1203/2388] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:56.209691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:56.211198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.223828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba57dd6-f789-4929-bbd4-e75f94caea74 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:56.227592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:56.228653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.229016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.229384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.239897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:56.259466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:56.272098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:56.284543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1204/2389] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:56.302768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540712-2c75-4713-924c-b522bf9e94da service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:56.315054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:56.316421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1186/2390] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:56.316570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.330251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99112fe4-7197-4884-a1fe-fc69351395fa service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:56.336655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:56.337622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.338036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.338919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] PATH_INFO: `/v3/users/11f2277920ba484a8ee102c47e2f986e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.340166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f2277920ba484a8ee102c47e2f986e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:56.374449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:56.524319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f2277920ba484a8ee102c47e2f986e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.534685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f2277920ba484a8ee102c47e2f986e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.574278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f2277920ba484a8ee102c47e2f986e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.575666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f2277920ba484a8ee102c47e2f986e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.591803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f2277920ba484a8ee102c47e2f986e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.603364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1205/2391] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:56 2021] DELETE /identity/v3/users/11f2277920ba484a8ee102c47e2f986e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:56.608204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.608566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.608910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.633538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:56.634851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.657350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:56.658862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.734013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1187/2392] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:56.742869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:56.744283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:56.756256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505808eb-4d72-4082-aa33-116a2270e7e7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:56.762000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:56.763027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.763596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.764125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] PATH_INFO: `/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.765718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bbe11b1b6544c88e04aa3f08f7477a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:56.803795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:56.842506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388384ec-7ae4-4bcb-a270-8f1585bd4de5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:56.846890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:56.852270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:56.852270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:56.852270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:56.861002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:56.896305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d566825-790a-4f80-8caa-a7bbf6deee2b service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:56.904470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1188/2393] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:28:56.935209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bbe11b1b6544c88e04aa3f08f7477a', 'request_id': 'req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.952071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bbe11b1b6544c88e04aa3f08f7477a', 'request_id': 'req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:56.997053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bbe11b1b6544c88e04aa3f08f7477a', 'request_id': 'req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.039953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] The token cache is being invalidate because project f2bbe11b1b6544c88e04aa3f08f7477a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:57.040543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.042995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8e752e-f9e1-4f17-84d4-177b2e0edb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.045433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1206/2394] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:56 2021] DELETE /identity/v3/projects/f2bbe11b1b6544c88e04aa3f08f7477a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:28:57.053277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.054025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.054456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.122677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:57.123947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.218277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1189/2395] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:57.226689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.227042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.227389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.254124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:57.255573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.265288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1207/2396] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:57.270184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:57.280849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e640d-cc9d-4a3b-acff-34464523a2c7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:57.286283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:57.287427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.287972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.288414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.289479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:57.290156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:57.317118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:57.318823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.322510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:57.340381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1190/2397] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:57.341291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:57.343127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.366273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f9ad4-8170-4313-a3ab-ddbcacb66039 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:57.371082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af781585-2be1-4408-89e7-54ca59714fd8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:57.387125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:57.389055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.389485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:57.390374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.390483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.390907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.391211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] PATH_INFO: `/v3/projects/0b1a140e47b74e60a7de9cc3119f2cb5` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.391328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] PATH_INFO: `/v3/projects/e8089745c5054dcf8e83898ca3d24513` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.392770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8089745c5054dcf8e83898ca3d24513)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:57.393764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1a140e47b74e60a7de9cc3119f2cb5)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:57.427757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:57.429602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:57.535210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1a140e47b74e60a7de9cc3119f2cb5', 'request_id': 'req-9edd6377-c119-458f-9ed3-02fe9e6d00cd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.542271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1a140e47b74e60a7de9cc3119f2cb5', 'request_id': 'req-9edd6377-c119-458f-9ed3-02fe9e6d00cd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.567460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8089745c5054dcf8e83898ca3d24513', 'request_id': 'req-b4155f11-20ac-48d0-8b49-758e52abfefa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.572956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8089745c5054dcf8e83898ca3d24513', 'request_id': 'req-b4155f11-20ac-48d0-8b49-758e52abfefa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.578809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1a140e47b74e60a7de9cc3119f2cb5', 'request_id': 'req-9edd6377-c119-458f-9ed3-02fe9e6d00cd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.596656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] The token cache is being invalidate because project 0b1a140e47b74e60a7de9cc3119f2cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:57.596963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.597658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.599384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1191/2398] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:57 2021] DELETE /identity/v3/projects/0b1a140e47b74e60a7de9cc3119f2cb5 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:57.600197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:57.601555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.607328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8089745c5054dcf8e83898ca3d24513', 'request_id': 'req-b4155f11-20ac-48d0-8b49-758e52abfefa'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.631873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] The token cache is being invalidate because project e8089745c5054dcf8e83898ca3d24513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:57.632548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.633935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b4155f11-20ac-48d0-8b49-758e52abfefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:57.635995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1208/2399] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:57 2021] DELETE /identity/v3/projects/e8089745c5054dcf8e83898ca3d24513 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:57.638108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.638745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.639206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.671610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:57.673573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.707497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd6377-c119-458f-9ed3-02fe9e6d00cd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:57.765507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1209/2400] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:57.773533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:57.775040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.788817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a074be-6a3b-43d2-9cf1-242d4249dd5e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:57.795871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:57.796782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.797120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.797448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] PATH_INFO: `/v3/users/98196d3e20034b2da650a638446b87f2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.798852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98196d3e20034b2da650a638446b87f2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:57.823326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:57.824287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.829987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.831523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.832624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:57.833641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:57.865284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86685ea-f6b2-44f1-9a36-59151543b5f2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:57.931698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1192/2401] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:57 2021] POST /identity/v3/projects => generated 377 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:57.933140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:57.933609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:57.934103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:57.990616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:57.994729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:57.998488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98196d3e20034b2da650a638446b87f2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.007482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98196d3e20034b2da650a638446b87f2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.086789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1193/2402] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:58.088132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.089409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.104250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98196d3e20034b2da650a638446b87f2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.105126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98196d3e20034b2da650a638446b87f2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.106276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c6854-7a28-46bf-ab73-484f2a08f520 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.118976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.119393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98196d3e20034b2da650a638446b87f2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.121255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.122195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.122989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.123945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.126869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1210/2403] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:57 2021] DELETE /identity/v3/users/98196d3e20034b2da650a638446b87f2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:58.127756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.129162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.168443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.218445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d895a-c204-4f6a-a8c2-926af3e30c2d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.223503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.224530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.225175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.225307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] PATH_INFO: `/v3/projects/a6cddc34ddc34368ae8ed74f23a36568` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.226614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cddc34ddc34368ae8ed74f23a36568)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.230980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1194/2404] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:58 2021] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:58.232562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.235110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.250555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dad5a-b561-43d7-b274-6790eb3abc0e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.257476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.259258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.259796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.260317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.261774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.262569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:28:58.263500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.301481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.316522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1195/2405] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:28:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:28:58.317410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.319529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.332246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7d93-ba64-4c00-9687-8aa7f465b287 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.341138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cddc34ddc34368ae8ed74f23a36568', 'request_id': 'req-3a9027a2-003d-4f66-8370-87af2133ea91'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.348037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cddc34ddc34368ae8ed74f23a36568', 'request_id': 'req-3a9027a2-003d-4f66-8370-87af2133ea91'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.380224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cddc34ddc34368ae8ed74f23a36568', 'request_id': 'req-3a9027a2-003d-4f66-8370-87af2133ea91'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.418518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] The token cache is being invalidate because project a6cddc34ddc34368ae8ed74f23a36568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:58.419455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.420486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.420812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.421510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.422012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.422578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.423183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1211/2406] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:58 2021] DELETE /identity/v3/projects/a6cddc34ddc34368ae8ed74f23a36568 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:58.427183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.427778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.429815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.445451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9027a2-003d-4f66-8370-87af2133ea91 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.451476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.452257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.452695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.453116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.454169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.461483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.494838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.503909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1196/2407] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:58 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:58.503909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.508476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.535631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6ec56-620f-48b7-86c6-218f3346e8ce admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.543504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.553818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.556584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1212/2408] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:28:58 2021] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:58.558243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.558940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.559403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] PATH_INFO: `/v3/users/f5d1e5b3e513486384e927571be6a05c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.563158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.563767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d1e5b3e513486384e927571be6a05c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.627285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.698550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4d463-120b-4198-9392-4ba85dc993b6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:58.710507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:58.711435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:58.711776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:58.712110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] PATH_INFO: `/v3/projects/c7f7a800c99942d1bc361e34668b9207/users/01fa8312837d448fa8fab4018ac91900/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:58.740907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7f7a800c99942d1bc361e34668b9207, user_id=01fa8312837d448fa8fab4018ac91900, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:58.774170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:58.796129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d1e5b3e513486384e927571be6a05c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.816913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d1e5b3e513486384e927571be6a05c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.842446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1213/2409] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:58 2021] PUT /identity/v3/projects/c7f7a800c99942d1bc361e34668b9207/users/01fa8312837d448fa8fab4018ac91900/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:58.845636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.866260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d1e5b3e513486384e927571be6a05c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.867299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d1e5b3e513486384e927571be6a05c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.883864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d1e5b3e513486384e927571be6a05c'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:58.891019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1197/2410] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:58 2021] DELETE /identity/v3/users/f5d1e5b3e513486384e927571be6a05c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:58.896605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:58.898060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:58.933638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60a6eb-df9f-4239-9cd6-a60ea234cf2b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:59.013635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:59.014412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.014684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3534fb0-a5d3-41f7-ab5e-2331e5afff06 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:59.014792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.015056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.015937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:59.020587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:59.021667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.022056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.022397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] PATH_INFO: `/v3/projects/ae5e5b9262be45b38f7dd92128b9d9ab` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.024051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5e5b9262be45b38f7dd92128b9d9ab)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:59.048912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef89c-2d78-47f0-be66-fdde720098df admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:59.057301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:59.111059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1214/2411] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:28:58 2021] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:28:59.111059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.111059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.111059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.149002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5e5b9262be45b38f7dd92128b9d9ab', 'request_id': 'req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.153148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] MFA Rules not processed for user `01fa8312837d448fa8fab4018ac91900`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:28:59.154450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.155183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5e5b9262be45b38f7dd92128b9d9ab', 'request_id': 'req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.202488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5e5b9262be45b38f7dd92128b9d9ab', 'request_id': 'req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.241295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] The token cache is being invalidate because project ae5e5b9262be45b38f7dd92128b9d9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:28:59.241642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.245274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.257181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1198/2412] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:58 2021] DELETE /identity/v3/projects/ae5e5b9262be45b38f7dd92128b9d9ab => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:59.257181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:59.258940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.265338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1215/2413] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:28:59 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:28:59.272238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:59.409575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70970516-b277-4f76-8b48-8986eec273b8 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:59.419962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:59.420274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128d7c3-7cf2-4d98-8230-8b04ca07ef5d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:59.420974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.421733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.422124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] PATH_INFO: `/v3/users/22493f67b8924964980a8114d54264c6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.423593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22493f67b8924964980a8114d54264c6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:59.435801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:59.436498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.436842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.437179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.438015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:59.482143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:59.502095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:59.513326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1199/2414] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:28:59 2021] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:28:59.514514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:59.516500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.613727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c79d51-de59-46ed-9b75-c10884ef9b46 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:28:59.617308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:28:59.618009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:28:59.618413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:28:59.618703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:28:59.621352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.649076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:28:59.678492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:28:59.685738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22493f67b8924964980a8114d54264c6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.698321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1200/2415] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:28:59 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:28:59.698994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:59.700726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22493f67b8924964980a8114d54264c6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.701815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.740581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22493f67b8924964980a8114d54264c6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.741430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22493f67b8924964980a8114d54264c6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.763696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22493f67b8924964980a8114d54264c6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:28:59.774362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1216/2416] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:28:59 2021] DELETE /identity/v3/users/22493f67b8924964980a8114d54264c6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:28:59.775051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:28:59.778359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:28:59.830230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804488df-53bb-40c8-9b83-8876b326bccb service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:00.000777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:00.002565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.002790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.003135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] PATH_INFO: `/v3/projects/5f88f17886c44e1e8385afde759f02f5` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.014415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f88f17886c44e1e8385afde759f02f5)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:00.075518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2521e8-0e2e-456c-90fc-bb484bb33cf3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:00.095431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:00.098529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.098902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.099199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] PATH_INFO: `/v3/projects/6c4210dee9d94904bbd99a6124b37497/users/20863712b2fd4d4db971ab38333532f7/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.109873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:00.158084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4210dee9d94904bbd99a6124b37497, user_id=20863712b2fd4d4db971ab38333532f7, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:00.197628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17381a-daff-4b82-80b1-1f2edbe105c9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:00.199641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f88f17886c44e1e8385afde759f02f5', 'request_id': 'req-e784774b-8519-47b1-90b0-14e0de988c45'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:00.205645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f88f17886c44e1e8385afde759f02f5', 'request_id': 'req-e784774b-8519-47b1-90b0-14e0de988c45'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:00.249308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f88f17886c44e1e8385afde759f02f5', 'request_id': 'req-e784774b-8519-47b1-90b0-14e0de988c45'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:00.258853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1217/2417] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:28:59 2021] PUT /identity/v3/projects/6c4210dee9d94904bbd99a6124b37497/users/20863712b2fd4d4db971ab38333532f7/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:00.269272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.269627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.270006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.294161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] The token cache is being invalidate because project 5f88f17886c44e1e8385afde759f02f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:00.294506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:00.296754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e784774b-8519-47b1-90b0-14e0de988c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:00.300759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1201/2418] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:28:59 2021] DELETE /identity/v3/projects/5f88f17886c44e1e8385afde759f02f5 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:00.307123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d701-41c3-4fce-9aee-f919a63a813f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.307525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d701-41c3-4fce-9aee-f919a63a813f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.307952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559d701-41c3-4fce-9aee-f919a63a813f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.405215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] MFA Rules not processed for user `20863712b2fd4d4db971ab38333532f7`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:00.407113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:00.412848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3559d701-41c3-4fce-9aee-f919a63a813f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:00.416813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3559d701-41c3-4fce-9aee-f919a63a813f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:00.556391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1218/2419] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:00 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:00.577306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:00.579420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:00.614491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1202/2420] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:00.624993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.625305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.625625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.689575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:00.690859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:00.712596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1203/2421] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:00.716812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:00.717488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da227ec-913e-4591-87d3-549f74ed5f17 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:00.726152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617a67e-595b-4e8f-8850-407aceb9ea6b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:00.727991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:00.729005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.730147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.730501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.732182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:00.732978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.733422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.733906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.734811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:00.735267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:00.749089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:00.790717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:00.795269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:00.805697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1204/2422] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:29:00.810916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1219/2423] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:00 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:29:00.811224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:00.824785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09418d11-06af-47bb-ab59-9fe24a6ec802 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:00.829960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:00.830947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:00.831579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:00.832098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:00.833017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:00.864002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:00.944095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1205/2424] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:00 2021] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:00.948948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:00.963130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:00.965264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:01.000121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc89-1948-4c41-8d6a-463abae08b2b service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.076396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc620302-fcb7-4515-8bba-ff7c95b16570 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.082546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.088309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.088309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.088309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] PATH_INFO: `/v3/projects/c1232b83913f423c8cee44c2cfd06f98` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.088309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1232b83913f423c8cee44c2cfd06f98)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.108631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.109321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.109659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.110021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.110746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.117640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.141878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.211002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1232b83913f423c8cee44c2cfd06f98', 'request_id': 'req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:01.219726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1232b83913f423c8cee44c2cfd06f98', 'request_id': 'req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:01.220250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1220/2425] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:00 2021] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:01.226280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.237812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c822cf-812e-4967-8e97-a2532574d768 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.270096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1232b83913f423c8cee44c2cfd06f98', 'request_id': 'req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:01.310556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.311359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.311728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.312064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.312856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.345234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.349626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] The token cache is being invalidate because project c1232b83913f423c8cee44c2cfd06f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:01.349995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:01.350756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-077ff471-a1f1-444b-80ec-8a1dfccf2ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:01.352345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1206/2426] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:00 2021] DELETE /identity/v3/projects/c1232b83913f423c8cee44c2cfd06f98 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:01.358614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1221/2427] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:01.358749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77c2ff-5010-41e8-88ef-f98855af8a17 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.359144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77c2ff-5010-41e8-88ef-f98855af8a17 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.359556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77c2ff-5010-41e8-88ef-f98855af8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.362761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.364631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:01.377982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960befb-813f-47e8-bb8f-544a6c29d2b6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.382912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.383820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.384161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.384480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1d77c2ff-5010-41e8-88ef-f98855af8a17 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:01.384583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] PATH_INFO: `/v3/projects/cae1a287942f490a9258958141154b04/users/c1d1aa539f444150b3cf2d8f7b61e340/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.386359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d77c2ff-5010-41e8-88ef-f98855af8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:01.394296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1207/2428] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:01.402840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.403188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.403526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.407301 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae1a287942f490a9258958141154b04, user_id=c1d1aa539f444150b3cf2d8f7b61e340, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.427452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:01.428668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:01.436351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1208/2429] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:01.437936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356a16e-0b7b-4795-905d-effe9179c472 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.440761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.450468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34bb7e-f005-4021-960c-918a60518104 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.455727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.456211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.456557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.456894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.457687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:01.458111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.474089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1222/2430] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:01 2021] PUT /identity/v3/projects/cae1a287942f490a9258958141154b04/users/c1d1aa539f444150b3cf2d8f7b61e340/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:01.484324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.484656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.484989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.487038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.509554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1209/2431] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:29:01.515180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.529661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31db32-aad2-4e10-a391-4aaec1f98053 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.530613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] MFA Rules not processed for user `c1d1aa539f444150b3cf2d8f7b61e340`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:01.531977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:01.606311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.607245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.610269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.610269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.610269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.627821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1223/2432] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:01.632772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.639402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.644736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6fb05-df85-4a62-bd56-c1c494acaebb None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.650036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.650825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.651690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.652018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.652753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.682788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.730970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1210/2433] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:01.734941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.759346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1224/2434] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:01.763428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:01.816464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1312d6-2cb8-4a11-85a5-fe0843a38f08 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.839261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f710f09-2804-4567-a019-52f62ac70f57 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:01.844014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.844696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.845042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.845378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.847924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.875852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.891448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:01.892143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:01.892524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:01.892830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:01.893556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:01.922918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:01.989956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1225/2435] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:01.991528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.002351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651bae1-a3b3-4ecf-9f92-102abbd3f042 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.007413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.013181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.013181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.013181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.013181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.040173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.042063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1211/2436] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:01 2021] POST /identity/v3/users => generated 291 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:02.043026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.052566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1226/2437] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:01 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:29:02.053220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9961d-84b1-4b47-82b7-2a5674f90f2d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.056801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.058548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.059352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.059690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.060019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.060812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.068936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced43d1-317b-4b44-b934-80c9cca1a39f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.074635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.075845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.076337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.076821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] PATH_INFO: `/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.092168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.101692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989dc7e854c542499456600e02022cca, user_id=1657ec3e11194dc0ab428366af1ecec7, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.106171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1212/2438] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:02.108676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.132225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fbf184-0173-4302-94ed-da822818fc07 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.142516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.143491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.143830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.144162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] PATH_INFO: `/v3/projects/3e6ee17ad78648c29fc19d8e4c2a87e4/users/162350f25dd647799397fa9a61986820/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.156366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.184612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6ee17ad78648c29fc19d8e4c2a87e4, user_id=162350f25dd647799397fa9a61986820, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.210288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1227/2439] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:02 2021] PUT /identity/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:02.214975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.223409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625252e-f503-4043-acf5-6c0ba0c0593e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.280024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1213/2440] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:02 2021] PUT /identity/v3/projects/3e6ee17ad78648c29fc19d8e4c2a87e4/users/162350f25dd647799397fa9a61986820/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:02.294636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.294987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.295320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.326670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28851e-3024-4b0b-8d4f-1f03831e0e49 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.343045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] MFA Rules not processed for user `162350f25dd647799397fa9a61986820`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:02.344670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:02.400247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.401478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.401820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.402170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.402963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.432446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1214/2441] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:02 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:02.435271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.437957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.448934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1228/2442] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:29:02.451073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9e477-d9ff-4706-9c86-af72de8e3b7d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.453669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.456343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.457638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.458419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.458829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.459663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.469767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb04d05-a440-43d4-968e-b3f36f0efcd0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.488006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.488970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.489316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.489653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] PATH_INFO: `/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.492089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989dc7e854c542499456600e02022cca, user_id=1657ec3e11194dc0ab428366af1ecec7, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.496777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.531563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.544669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1229/2443] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:02 2021] PUT /identity/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:02.549489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.571405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1215/2444] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:02 2021] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:02.575850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.651496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4fdd-5658-4eb4-948f-379fa023e797 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.676771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb926e-4fae-43d2-bdb3-c3d8391fe262 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.687474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.688824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.689751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.690223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.691703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.731307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.764200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.764898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.765240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.765575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.766518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.789644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1216/2445] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:02 2021] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:02.790981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.796481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.801128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52c800-ae3a-45ed-9189-ce47b08385f0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.805995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.806665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.807006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.807370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.808153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.808654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1230/2446] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:02.812837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.823229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e6a771-4ae7-4ee1-b799-55c9f3cb0a55 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.828315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.829212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.829555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.829946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] PATH_INFO: `/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.831918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989dc7e854c542499456600e02022cca, user_id=1657ec3e11194dc0ab428366af1ecec7, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.837340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.849429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1217/2447] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:02 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:02.853614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:02.862002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f4ca9-69f3-43de-99fa-867a40176a10 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.863870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd2f99-7f07-4e8b-a136-e15852f68165 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:02.868812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:02.869736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.870109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.870441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] PATH_INFO: `/v3/projects/6c09b4e839a64553b0572045b96771d6/users/9cfb6ed6e9d44d7282a69bef195d1330/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.892420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c09b4e839a64553b0572045b96771d6, user_id=9cfb6ed6e9d44d7282a69bef195d1330, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:02.907221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1231/2448] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:02 2021] PUT /identity/v3/projects/989dc7e854c542499456600e02022cca/users/1657ec3e11194dc0ab428366af1ecec7/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:02.918777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.919126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.919461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:02.922857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91592d-e935-4802-8f9f-0982d499e508 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:02.958785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] MFA Rules not processed for user `1657ec3e11194dc0ab428366af1ecec7`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:02.960014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:02.991037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1218/2449] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:02 2021] PUT /identity/v3/projects/6c09b4e839a64553b0572045b96771d6/users/9cfb6ed6e9d44d7282a69bef195d1330/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:02.992840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:02.993339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:02.993662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.037072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] MFA Rules not processed for user `9cfb6ed6e9d44d7282a69bef195d1330`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:03.038719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:03.059503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1232/2450] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:02 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:03.069234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.070672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:03.118054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1219/2451] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:02 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:03.123406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.163011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91bd69-84b8-487a-b8c2-2fcc4f75df55 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.202988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe21f5-3221-4d89-8e0b-23f1d72a0052 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.207974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.209193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.209193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.209532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.210422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.224915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.225577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.225943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.226273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.240458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.300946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.325998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1220/2452] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:03 2021] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:03.330104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.330725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.341653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1233/2453] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:03 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:29:03.453235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a27500-74a4-43e6-b718-7d0c193c2efd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.459263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.460564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.460692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.461002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.461760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.504469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.552349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.565236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4857d2-68ad-4a6e-8525-efa012f91851 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.572192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.573405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.573911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.575262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] PATH_INFO: `/v3/users/c1d1aa539f444150b3cf2d8f7b61e340` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.576629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d1aa539f444150b3cf2d8f7b61e340)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.607329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.610070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1221/2454] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:03 2021] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:03.616960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.627853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130e389-fb4c-4928-9a79-579569b2f828 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.636083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.636774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.637120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.637459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.638318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.668025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.680384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1222/2455] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:29:03.684560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.695040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2940a-8384-47fe-b927-2aeeee756981 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.699965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.700865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.701295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.701633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] PATH_INFO: `/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.742627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d1aa539f444150b3cf2d8f7b61e340'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:03.752439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d1aa539f444150b3cf2d8f7b61e340'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:03.791613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d1aa539f444150b3cf2d8f7b61e340'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:03.792797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d1aa539f444150b3cf2d8f7b61e340'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:03.799388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd0bf33def841bfaa4c4dace4095347, user_id=bfcf257339e548bb97b99ad1b9b93974, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.805643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a758d7c9-7935-40d5-b459-e1ed8a234ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d1aa539f444150b3cf2d8f7b61e340'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:03.811949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1234/2456] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:03 2021] DELETE /identity/v3/users/c1d1aa539f444150b3cf2d8f7b61e340 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:03.816436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.816775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.817108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.828648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:03.839782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:03.840987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:03.870462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1223/2457] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:03 2021] PUT /identity/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:03.874815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.876570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:03.918735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1235/2458] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:03.930025 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:03.931521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:03.951234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6769-9903-4c01-a7b3-29730f1bd3e0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:03.956379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:03.958391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:03.958739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:03.959073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:03.959953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:03.998923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.015737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1224/2459] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:03 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:29:04.016842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.027584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfbd5f-5edf-418e-8a03-ce4c694afb70 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.032547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.033447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.034259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.034383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] PATH_INFO: `/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.036314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd0bf33def841bfaa4c4dace4095347, user_id=bfcf257339e548bb97b99ad1b9b93974, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.036434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e68828-e93b-40e1-a766-fe65aefd42d1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.066470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.078190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1225/2460] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:04 2021] PUT /identity/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:04.081993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.096257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.096917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.097258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.097590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.107390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.136222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.146278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1236/2461] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:29:04.154892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727b4f-57b5-4db5-a26c-7ac6f8ef300b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.159867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.160551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.160900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.161234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.162120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.191675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7276fb-331a-4645-b94f-f8059ca9ba30 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.203312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1226/2462] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:04 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:04.207845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.217891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a76a4c-575c-4837-b73a-926199beceb7 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.222855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.223859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.224303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.224642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] PATH_INFO: `/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.226831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd0bf33def841bfaa4c4dace4095347, user_id=bfcf257339e548bb97b99ad1b9b93974, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.257708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.294770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1237/2463] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:04 2021] PUT /identity/v3/projects/ffd0bf33def841bfaa4c4dace4095347/users/bfcf257339e548bb97b99ad1b9b93974/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:04.305557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.305963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.306306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.345493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] MFA Rules not processed for user `bfcf257339e548bb97b99ad1b9b93974`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:04.346778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:04.433844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1227/2464] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:04 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:04.443385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.445767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:04.524332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70752b-f79c-4246-a126-ab629800acb6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.536960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.536960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.536960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.536960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.537389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:04.589762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.591357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:04.605687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.635029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.646532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1238/2465] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:04 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:04.679961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1555b-992a-4915-92c8-58cf402abc5c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.684845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.685722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.686077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.686546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] PATH_INFO: `/v3/projects/cae1a287942f490a9258958141154b04` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.687758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae1a287942f490a9258958141154b04)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.716544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:04.791393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae1a287942f490a9258958141154b04', 'request_id': 'req-5b607cf8-91ed-4988-9ccb-62b6010026b6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:04.797214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae1a287942f490a9258958141154b04', 'request_id': 'req-5b607cf8-91ed-4988-9ccb-62b6010026b6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:04.835257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae1a287942f490a9258958141154b04', 'request_id': 'req-5b607cf8-91ed-4988-9ccb-62b6010026b6'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:04.853371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] The token cache is being invalidate because project cae1a287942f490a9258958141154b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:04.853703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:04.854881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:04.856463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1228/2466] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:04 2021] DELETE /identity/v3/projects/cae1a287942f490a9258958141154b04 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:04.860858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:04.871677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14581c-dc69-44ba-a95c-59905f8ddaec service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:04.938452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:04.939339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:04.939675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:04.940002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] PATH_INFO: `/v3/users/1657ec3e11194dc0ab428366af1ecec7` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:04.941210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1657ec3e11194dc0ab428366af1ecec7)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:04.970693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:05.085057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1657ec3e11194dc0ab428366af1ecec7'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.093352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1657ec3e11194dc0ab428366af1ecec7'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.130092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1657ec3e11194dc0ab428366af1ecec7'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.130773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1657ec3e11194dc0ab428366af1ecec7'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.145813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9c49e137-f1b7-4b56-a894-b9bdd812b0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1657ec3e11194dc0ab428366af1ecec7'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.152429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1239/2467] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:04 2021] DELETE /identity/v3/users/1657ec3e11194dc0ab428366af1ecec7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:05.715715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:05.717274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:05.740762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b607cf8-91ed-4988-9ccb-62b6010026b6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:05.813926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:05.815063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:05.815411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:05.815869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] PATH_INFO: `/v3/projects/989dc7e854c542499456600e02022cca` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:05.817150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989dc7e854c542499456600e02022cca)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:05.847002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:05.941517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989dc7e854c542499456600e02022cca', 'request_id': 'req-20223cfa-4b7f-4d54-95bd-5d4d106d9916'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.947041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989dc7e854c542499456600e02022cca', 'request_id': 'req-20223cfa-4b7f-4d54-95bd-5d4d106d9916'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:05.996954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989dc7e854c542499456600e02022cca', 'request_id': 'req-20223cfa-4b7f-4d54-95bd-5d4d106d9916'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:06.016164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] The token cache is being invalidate because project 989dc7e854c542499456600e02022cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:06.016467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:06.017173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-20223cfa-4b7f-4d54-95bd-5d4d106d9916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:06.018989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1229/2468] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:05 2021] DELETE /identity/v3/projects/989dc7e854c542499456600e02022cca => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:06.025372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.025953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.026625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.067619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:06.068870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:06.141883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1240/2469] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:06.150384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5223d-5244-4837-be11-b5447135e92c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.150752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5223d-5244-4837-be11-b5447135e92c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.151559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5223d-5244-4837-be11-b5447135e92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.175918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-22b5223d-5244-4837-be11-b5447135e92c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:06.177145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-22b5223d-5244-4837-be11-b5447135e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:06.184839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1230/2470] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:06.189331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.199148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f9029-1abb-412b-9e36-2d027d185562 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.203769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.204433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.204776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.205113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.205936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:06.206291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.235412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.249604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1241/2471] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:29:06.254226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5223d-5244-4837-be11-b5447135e92c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.264379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5223d-5244-4837-be11-b5447135e92c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.269512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.270207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.270546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.270881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.271604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.303304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.392497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1231/2472] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:06.397011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.415503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553ca9c-e0b5-4a55-b716-127c40157da2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.493828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.495198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.495956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.496364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.497198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.530855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.585381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1242/2473] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:06.595894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.606998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48796124-34fa-4244-a2f4-4f3d9c4f3666 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.613928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.613928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.613928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.613928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.614226 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.642777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.654331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1232/2474] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:06 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:06.658638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.668723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:06.670517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:06.675143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00b107-0de7-46de-b5d1-fb5d77cca95a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.680113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.681015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.681352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.681687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] PATH_INFO: `/v3/projects/1e4059ee6ccf4d5b88ad1cbc319cc6df/users/4e31e45c3021488592ba71e5d0c0d6ae/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.705087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4059ee6ccf4d5b88ad1cbc319cc6df, user_id=4e31e45c3021488592ba71e5d0c0d6ae, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.736433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1879d2-7719-4eee-8b7c-4707739ce611 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.751340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607975e-aa5c-43c4-a79e-bc06eeec1260 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:06.754423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:06.755173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.755594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.756011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.757976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:06.777844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1243/2475] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:06 2021] PUT /identity/v3/projects/1e4059ee6ccf4d5b88ad1cbc319cc6df/users/4e31e45c3021488592ba71e5d0c0d6ae/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:06.786962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:06.787311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:06.789769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:06.832578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] MFA Rules not processed for user `4e31e45c3021488592ba71e5d0c0d6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:06.833870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:06.863456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:06.893841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:06.905209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1233/2476] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:06 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:06.980535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1244/2477] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:06.987113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.000043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bdf7e-4e08-4553-89a3-4fba2ff919e3 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.081821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.082502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.083324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.083324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.083916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.116022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.170846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1234/2478] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:06 2021] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:07.175001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.186444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaceef9f-0b42-4e11-8ab6-54383369594b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.252562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.253246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.253586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.253954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.254686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.283091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.328645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1245/2479] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:07 2021] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:07.332946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.343214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf27ac2-0812-448e-8561-fd91b6f1ee96 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.348148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.348827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.349172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.349509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.350382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.379586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.391677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1235/2480] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:07 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:07.396177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.406484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd6735-2f2c-4230-9bb6-29ba1d0eacab admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.411374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.412359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.412702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.413037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] PATH_INFO: `/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.434983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6482ce5380a149a38c67cb71c451cde0, user_id=02019d89bf734add8b39da1d83130b2d, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.465107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.505889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1246/2481] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:07 2021] PUT /identity/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:07.509911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.520525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45450a-0c62-4d51-a258-037cd637ec8c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.610125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.610819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.611186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.611558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.612399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.643165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.655920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1236/2482] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:07 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:07.660446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.672090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd485ee-ece8-4df1-bc7e-098f6bfeccec admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.677013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.678038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.678390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.678726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] PATH_INFO: `/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.680826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6482ce5380a149a38c67cb71c451cde0, user_id=02019d89bf734add8b39da1d83130b2d, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.712171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.723919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1247/2483] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:07 2021] PUT /identity/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:07.728098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.738287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0f91-cd12-4f34-bc40-1ca1f78b6f7f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.808551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.809230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.809570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.809958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.810748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.839219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefcccf-521a-4b5b-8027-8765b3987fc0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.850545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1237/2484] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:07 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:07.855015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:07.865472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73012bb0-cfff-4f13-893a-c6b9b197ebfc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:07.870773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:07.871723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.872056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.872383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] PATH_INFO: `/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:07.874485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6482ce5380a149a38c67cb71c451cde0, user_id=02019d89bf734add8b39da1d83130b2d, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:07.904396 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:07.964608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1248/2485] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:07 2021] PUT /identity/v3/projects/6482ce5380a149a38c67cb71c451cde0/users/02019d89bf734add8b39da1d83130b2d/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:07.976472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:07.976472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:07.977292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:08.017570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] MFA Rules not processed for user `02019d89bf734add8b39da1d83130b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:08.018829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:08.105345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1238/2486] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:07 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:08.180333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:08.182643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:08.250079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb591e-c3d4-44cc-827f-a1237b0bc255 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:08.253677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:08.254356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:08.254697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:08.255028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:08.324256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:08.352529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:08.362400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1249/2487] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:08 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:09.023286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:09.034130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a61c83-78b1-4380-a850-4144baf4ab98 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:09.038124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:09.038804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:09.039174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:09.039565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:09.041600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:09.120845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:09.150162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:09.162306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1239/2488] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:09 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:15.629096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:15.638427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be78464-bbc6-4b21-af2a-bb618c3e6290 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:15.642638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:15.643289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:15.643623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:15.643950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:15.653626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:15.683223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a6062-996d-4fef-85e9-b5ea0c7ed655 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:15.693642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1250/2489] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:15 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:16.801692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:16.804903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:16.890565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238d6df-a998-40ab-9532-58115b0b913a service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:16.895140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:16.896032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:16.896371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:16.896703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] PATH_INFO: `/v3/users/162350f25dd647799397fa9a61986820` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:16.898216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162350f25dd647799397fa9a61986820)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:16.927598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:17.022781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162350f25dd647799397fa9a61986820'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.031540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162350f25dd647799397fa9a61986820'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.075272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162350f25dd647799397fa9a61986820'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.075864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162350f25dd647799397fa9a61986820'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.089582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162350f25dd647799397fa9a61986820'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.096017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1240/2490] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:16 2021] DELETE /identity/v3/users/162350f25dd647799397fa9a61986820 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:17.102856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:17.103200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:17.103582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:17.127167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:17.128371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:17.196493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1251/2491] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:17.208759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:17.210255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:17.278041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08a1e-b96a-4bb8-b5e8-05311be89358 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:17.281549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:17.282222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:17.282559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:17.282887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:17.292435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:17.320523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:17.330736 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1241/2492] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:17.818203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:17.820630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:17.836867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f30b3-cc84-4e3b-859b-cac81121e241 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:17.843277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:17.844496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:17.845106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:17.845565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] PATH_INFO: `/v3/projects/3e6ee17ad78648c29fc19d8e4c2a87e4` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:17.846960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6ee17ad78648c29fc19d8e4c2a87e4)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:17.861158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:17.864384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:17.883395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09473e1-7def-4d4d-af6b-53a7a50ecd90 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:17.883729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:17.897537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:17.898572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:17.898999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:17.899419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] PATH_INFO: `/v3/users/20863712b2fd4d4db971ab38333532f7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:17.900961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20863712b2fd4d4db971ab38333532f7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:17.930678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:17.974205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6ee17ad78648c29fc19d8e4c2a87e4', 'request_id': 'req-7954fe8b-4a64-43e1-a7ff-fce0c348e216'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:17.980427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6ee17ad78648c29fc19d8e4c2a87e4', 'request_id': 'req-7954fe8b-4a64-43e1-a7ff-fce0c348e216'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.028201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6ee17ad78648c29fc19d8e4c2a87e4', 'request_id': 'req-7954fe8b-4a64-43e1-a7ff-fce0c348e216'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.047746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] The token cache is being invalidate because project 3e6ee17ad78648c29fc19d8e4c2a87e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:18.048186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.049011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.050624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1252/2493] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:17 2021] DELETE /identity/v3/projects/3e6ee17ad78648c29fc19d8e4c2a87e4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:18.055006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:18.056335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:18.060934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20863712b2fd4d4db971ab38333532f7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.069315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20863712b2fd4d4db971ab38333532f7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.105882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20863712b2fd4d4db971ab38333532f7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.106584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20863712b2fd4d4db971ab38333532f7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.121151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7d1c930c-04b4-4ca6-8416-c16f9d23d377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20863712b2fd4d4db971ab38333532f7'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.132664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1242/2494] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:17 2021] DELETE /identity/v3/users/20863712b2fd4d4db971ab38333532f7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:18.136780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954fe8b-4a64-43e1-a7ff-fce0c348e216 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:18.137664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:18.138482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:18.140163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:18.170147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:18.171953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:18.211181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:18.212089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:18.213540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:18.214121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] PATH_INFO: `/v3/users/9cfb6ed6e9d44d7282a69bef195d1330` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:18.215361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cfb6ed6e9d44d7282a69bef195d1330)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:18.244580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:18.249191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1243/2495] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:18.261180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:18.263024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:18.339837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1650c0-b215-4edd-a24f-f5d95b965489 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:18.343680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:18.344424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:18.344656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:18.344988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:18.355663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:18.384661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:18.388514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cfb6ed6e9d44d7282a69bef195d1330'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.395645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1244/2496] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:18.399701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cfb6ed6e9d44d7282a69bef195d1330'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.430881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cfb6ed6e9d44d7282a69bef195d1330'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.431609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cfb6ed6e9d44d7282a69bef195d1330'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.444378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cfb6ed6e9d44d7282a69bef195d1330'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:18.451373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1253/2497] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:18 2021] DELETE /identity/v3/users/9cfb6ed6e9d44d7282a69bef195d1330 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:18.888774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:18.890318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:18.906093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2b57-090f-4bad-86f0-3b50f44ee26b service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:18.997438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:18.998406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:18.998745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:18.999075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] PATH_INFO: `/v3/projects/6c4210dee9d94904bbd99a6124b37497` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.000372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4210dee9d94904bbd99a6124b37497)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.039172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.041888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.043470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:19.056541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c418a-f5b6-42d3-866c-84012d6e0121 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.061359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.062381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.062821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.063248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] PATH_INFO: `/v3/projects/6c09b4e839a64553b0572045b96771d6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.064588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c09b4e839a64553b0572045b96771d6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.094237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.126131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4210dee9d94904bbd99a6124b37497', 'request_id': 'req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.131757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4210dee9d94904bbd99a6124b37497', 'request_id': 'req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.168014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4210dee9d94904bbd99a6124b37497', 'request_id': 'req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.169993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c09b4e839a64553b0572045b96771d6', 'request_id': 'req-e9b07947-82a5-4321-a051-3f3aa3a2e683'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.175265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c09b4e839a64553b0572045b96771d6', 'request_id': 'req-e9b07947-82a5-4321-a051-3f3aa3a2e683'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.186113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] The token cache is being invalidate because project 6c4210dee9d94904bbd99a6124b37497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:19.186446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.187128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-34a6fc3b-fc21-4b03-8aef-a39cc5df25f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.188848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1245/2498] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:18 2021] DELETE /identity/v3/projects/6c4210dee9d94904bbd99a6124b37497 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:19.194558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b550-92e8-415c-be7a-c952e0878708 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.194936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b550-92e8-415c-be7a-c952e0878708 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.195238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b550-92e8-415c-be7a-c952e0878708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.202400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c09b4e839a64553b0572045b96771d6', 'request_id': 'req-e9b07947-82a5-4321-a051-3f3aa3a2e683'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.219901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3753b550-92e8-415c-be7a-c952e0878708 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:19.221121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3753b550-92e8-415c-be7a-c952e0878708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:19.221678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] The token cache is being invalidate because project 6c09b4e839a64553b0572045b96771d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:19.222157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.223093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.224794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1254/2499] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:19 2021] DELETE /identity/v3/projects/6c09b4e839a64553b0572045b96771d6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:19.229916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.231266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:19.301758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1246/2500] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:19.303397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.303744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.304080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.320426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07947-82a5-4321-a051-3f3aa3a2e683 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.325610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.326595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.326931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.327261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] PATH_INFO: `/v3/users/bfcf257339e548bb97b99ad1b9b93974` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.328465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcf257339e548bb97b99ad1b9b93974)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.329717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:19.331006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:19.340238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:19.344578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.353585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f80fc-6b53-4509-b9db-e03f81c2bf5c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.357246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.358593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.359247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.359625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.360002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.360787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:19.361142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.389800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.404686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1248/2502] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:29:19.409452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.419615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231c0c4-6192-48f0-a909-796b7d0ba7b9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.424237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.424886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.425230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.425568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.426328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.455317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.467610 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcf257339e548bb97b99ad1b9b93974'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.476894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcf257339e548bb97b99ad1b9b93974'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.503293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1249/2503] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:19 2021] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:19.507086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.515366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcf257339e548bb97b99ad1b9b93974'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.516010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcf257339e548bb97b99ad1b9b93974'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.530066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcf257339e548bb97b99ad1b9b93974'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:19.537990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1255/2504] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:19 2021] DELETE /identity/v3/users/bfcf257339e548bb97b99ad1b9b93974 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:19.584567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69271-bb84-4568-ad7d-b10dea3b8b1d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.667451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.668136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.668479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.668807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.669526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.697904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.742896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1250/2505] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:19 2021] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:19.745323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.746958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:19.762898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58a706-0649-4b29-b2bd-9b02bee9f1d4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.768344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.769346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.771497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.771890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.772724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.805065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e2c5d-4b62-40f2-9fad-024bfe9fb036 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.816714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1256/2506] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:19 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:19.821367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:19.831671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b58d-f06d-486e-8673-22c7fcdd2c52 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:19.836335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:19.837231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.837566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.838435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] PATH_INFO: `/v3/projects/6bdcb08d325447d59507e12df3ede633/users/cc382b76eb294b6b868c535b516f1dff/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:19.860149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdcb08d325447d59507e12df3ede633, user_id=cc382b76eb294b6b868c535b516f1dff, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:19.889806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:19.952650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1251/2507] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:19 2021] PUT /identity/v3/projects/6bdcb08d325447d59507e12df3ede633/users/cc382b76eb294b6b868c535b516f1dff/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:19.967764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:19.983804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:19.983804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.035831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.038131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:20.049521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] MFA Rules not processed for user `cc382b76eb294b6b868c535b516f1dff`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:20.051138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:20.121055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466326b7-7205-4ae1-9afe-b448fa8026d0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.125743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.126678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.127018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.127356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] PATH_INFO: `/v3/projects/ffd0bf33def841bfaa4c4dace4095347` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.128576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd0bf33def841bfaa4c4dace4095347)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.131556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1257/2508] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:19 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:20.142906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.144305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:20.162704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.216439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98444-e2ab-449c-a175-b24860af4f95 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.220031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.220684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.221023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.221353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.230522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.246980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd0bf33def841bfaa4c4dace4095347', 'request_id': 'req-93fe6f5d-73d9-4829-94a5-b3dee298bce4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:20.252462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd0bf33def841bfaa4c4dace4095347', 'request_id': 'req-93fe6f5d-73d9-4829-94a5-b3dee298bce4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:20.259324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82893c-4129-4a7e-8014-a7f318071791 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.270204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1258/2509] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:20 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:29:20.288418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd0bf33def841bfaa4c4dace4095347', 'request_id': 'req-93fe6f5d-73d9-4829-94a5-b3dee298bce4'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:20.310097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] The token cache is being invalidate because project ffd0bf33def841bfaa4c4dace4095347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:20.310623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:20.311488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-93fe6f5d-73d9-4829-94a5-b3dee298bce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:20.313509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1252/2510] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:20 2021] DELETE /identity/v3/projects/ffd0bf33def841bfaa4c4dace4095347 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:20.320906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.321385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.321722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.347176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:20.351875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:20.437481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1259/2511] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:20.446700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.447052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.447473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.488063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:20.489607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:20.499578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1253/2512] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:20.504235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.520370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7db72e-f617-433d-aac6-b6c551d6f806 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.525712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.526494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.527188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.527593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.528596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:20.529030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.558198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.573667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1260/2513] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:29:20.578708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.589936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7766c-09b8-446e-925d-ecfe958a243d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.594813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.595485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.595824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.596158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.596893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.625822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.687540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1254/2514] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:20 2021] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:20.688690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.701071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5192b9b-bfa1-40bd-880c-0ebb4150d525 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.768404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.769175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.769576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.769963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.770712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.800241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.843189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1261/2515] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:20 2021] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:20.847562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.861702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013370f5-96ea-436f-b6ac-fe74f3340b63 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.868430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.869702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.870238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.870576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.871373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.900912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297ad5b-4a46-46e0-b1d8-be73f4c125e8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:20.913136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1255/2516] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:20 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:20.917989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:20.931356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eebc2-3f2e-4e35-bb4a-c987dc4003ed admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:20.939741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:20.943607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:20.943607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:20.943607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] PATH_INFO: `/v3/projects/04a7ec7ce44b4112857cd427cab069d9/users/1c071af3feab43d9aff4ecc3cb097cee/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:20.963519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a7ec7ce44b4112857cd427cab069d9, user_id=1c071af3feab43d9aff4ecc3cb097cee, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:20.993258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:21.073626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1262/2517] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:20 2021] PUT /identity/v3/projects/04a7ec7ce44b4112857cd427cab069d9/users/1c071af3feab43d9aff4ecc3cb097cee/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:21.083950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f805-8fe7-4155-91f1-3f11b7886942 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:21.084828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f805-8fe7-4155-91f1-3f11b7886942 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:21.085595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553f805-8fe7-4155-91f1-3f11b7886942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:21.129056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4553f805-8fe7-4155-91f1-3f11b7886942 None None] MFA Rules not processed for user `1c071af3feab43d9aff4ecc3cb097cee`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:21.130512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4553f805-8fe7-4155-91f1-3f11b7886942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:21.229266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1256/2518] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:21 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:21.270331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:21.272178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:21.343740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681bb41-2277-4d0f-b9e2-d217cf597cb0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:21.347358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:21.350116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:21.350116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:21.350116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:21.358071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:21.387261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:21.397070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1263/2519] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:21 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:23.424277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd69a-257f-4ceb-b39b-2854867cbbe8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:23.424884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd69a-257f-4ceb-b39b-2854867cbbe8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:23.424964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bd69a-257f-4ceb-b39b-2854867cbbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:23.456004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ad5bd69a-257f-4ceb-b39b-2854867cbbe8 None None] MFA Rules not processed for user `1c071af3feab43d9aff4ecc3cb097cee`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:23.457236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ad5bd69a-257f-4ceb-b39b-2854867cbbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:23.464483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1257/2520] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:23 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:27.144418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:27.146167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:27.231985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa2bd8-0112-47ff-9ca9-93cd89163a5b service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:27.237069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:27.238076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:27.238495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:27.238906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] PATH_INFO: `/v3/users/4e31e45c3021488592ba71e5d0c0d6ae` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:27.240209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e31e45c3021488592ba71e5d0c0d6ae)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:27.273658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:27.393100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e31e45c3021488592ba71e5d0c0d6ae'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:27.405692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e31e45c3021488592ba71e5d0c0d6ae'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:27.458351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e31e45c3021488592ba71e5d0c0d6ae'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:27.459163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e31e45c3021488592ba71e5d0c0d6ae'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:27.474379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e31e45c3021488592ba71e5d0c0d6ae'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:27.483467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1264/2521] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:27 2021] DELETE /identity/v3/users/4e31e45c3021488592ba71e5d0c0d6ae => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:27.488520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:27.490006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:27.490459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:27.518765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:27.521921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:27.594346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1258/2522] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:27.605735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:27.607340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:27.678438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42618e39-50e3-49c8-b14c-82a9d76c9bce admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:27.685970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:27.686705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:27.687114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:27.687523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:27.697826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:27.726643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:27.738649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1265/2523] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:28.362696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:28.364395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:28.377531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36684cb-59ec-4657-b5eb-465cee382497 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:28.386350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:28.388514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:28.389951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:28.390499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] PATH_INFO: `/v3/projects/1e4059ee6ccf4d5b88ad1cbc319cc6df` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:28.392246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4059ee6ccf4d5b88ad1cbc319cc6df)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:28.422756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:28.503416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4059ee6ccf4d5b88ad1cbc319cc6df', 'request_id': 'req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.509780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4059ee6ccf4d5b88ad1cbc319cc6df', 'request_id': 'req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.539583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4059ee6ccf4d5b88ad1cbc319cc6df', 'request_id': 'req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.560366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] The token cache is being invalidate because project 1e4059ee6ccf4d5b88ad1cbc319cc6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:28.560714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.562008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.563842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1259/2524] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:28 2021] DELETE /identity/v3/projects/1e4059ee6ccf4d5b88ad1cbc319cc6df => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:28.568180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:28.580782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15b421-c725-438b-ab37-124bc1e2b503 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:28.670628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:28.671608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:28.671980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:28.672310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] PATH_INFO: `/v3/users/02019d89bf734add8b39da1d83130b2d` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:28.676606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02019d89bf734add8b39da1d83130b2d)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:28.714782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:28.849531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02019d89bf734add8b39da1d83130b2d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.858894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02019d89bf734add8b39da1d83130b2d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.892013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02019d89bf734add8b39da1d83130b2d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.892665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02019d89bf734add8b39da1d83130b2d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.905803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02019d89bf734add8b39da1d83130b2d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:28.912480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1266/2525] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:28 2021] DELETE /identity/v3/users/02019d89bf734add8b39da1d83130b2d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:29.629372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:29.632111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:29.665150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cb0e-e9c2-473b-8880-de4cdb8ca20a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:29.749910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:29.751478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:29.762214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:29.763297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:29.763781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:29.764254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] PATH_INFO: `/v3/projects/6482ce5380a149a38c67cb71c451cde0` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:29.766184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6482ce5380a149a38c67cb71c451cde0)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:29.798383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:29.865079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412612dd-b5af-4c81-a6ec-c4ec05ccf70b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:29.870823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:29.872204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:29.872558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:29.872893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] PATH_INFO: `/v3/users/01fa8312837d448fa8fab4018ac91900` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:29.874459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fa8312837d448fa8fab4018ac91900)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:29.914460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:29.920745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6482ce5380a149a38c67cb71c451cde0', 'request_id': 'req-845c6735-c949-4567-9387-d909800c8020'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:29.937060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6482ce5380a149a38c67cb71c451cde0', 'request_id': 'req-845c6735-c949-4567-9387-d909800c8020'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:29.968505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6482ce5380a149a38c67cb71c451cde0', 'request_id': 'req-845c6735-c949-4567-9387-d909800c8020'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.018765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] The token cache is being invalidate because project 6482ce5380a149a38c67cb71c451cde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:30.019346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.020486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.022256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1260/2526] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:29 2021] DELETE /identity/v3/projects/6482ce5380a149a38c67cb71c451cde0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:30.023482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.025334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.051397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fa8312837d448fa8fab4018ac91900'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.060794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fa8312837d448fa8fab4018ac91900'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.108285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c6735-c949-4567-9387-d909800c8020 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.114600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.115518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.115862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.116334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] PATH_INFO: `/v3/users/cc382b76eb294b6b868c535b516f1dff` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.118370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc382b76eb294b6b868c535b516f1dff)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.134424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fa8312837d448fa8fab4018ac91900'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.135790 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fa8312837d448fa8fab4018ac91900'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.151049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.154573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e1fe6a94-af54-45cf-9231-3bcf5ec3d03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fa8312837d448fa8fab4018ac91900'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.164161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1267/2527] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:29 2021] DELETE /identity/v3/users/01fa8312837d448fa8fab4018ac91900 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:30.165814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff095-6377-4b91-8d64-605deaa64050 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.166413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff095-6377-4b91-8d64-605deaa64050 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.167347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff095-6377-4b91-8d64-605deaa64050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.207720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-29eff095-6377-4b91-8d64-605deaa64050 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:30.209353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-29eff095-6377-4b91-8d64-605deaa64050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.291026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:30.293128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd7a-6051-48a2-b36b-55aa365e316f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.293941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd7a-6051-48a2-b36b-55aa365e316f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.294397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ddd7a-6051-48a2-b36b-55aa365e316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.307591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc382b76eb294b6b868c535b516f1dff'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.319860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-484ddd7a-6051-48a2-b36b-55aa365e316f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:30.321216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-484ddd7a-6051-48a2-b36b-55aa365e316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.326781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc382b76eb294b6b868c535b516f1dff'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.329843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1269/2529] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:30.331318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.331318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.331830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.360367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:30.361602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.374180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1270/2530] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:30.374180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.374180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.384314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc382b76eb294b6b868c535b516f1dff'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.387364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc382b76eb294b6b868c535b516f1dff'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.404763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc382b76eb294b6b868c535b516f1dff'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:30.413585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1261/2531] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:30 2021] DELETE /identity/v3/users/cc382b76eb294b6b868c535b516f1dff => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:30.419099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.420585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.485271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72fd92-de87-4e54-844f-35c5a8e593d0 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.514131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73a99d-511d-44d0-9bb0-84991ceab2c6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.519286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.520148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.520641 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.521137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.522158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:30.522665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.552591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d8581-4155-4091-81ed-fb573125ce21 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.555086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.556625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.556625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.556625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.559221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.571168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1262/2532] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:29:30.572447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.573487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.573872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.575406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.601108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:30.602389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.604929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.613490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1263/2533] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:30.613490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.627978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6df909-98bd-4542-81ef-7585e4342792 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.630564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:30.631506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.632438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.633111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.633446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.633751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.634516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.636594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:30.650434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5be497-caa4-4da4-bd55-7267fdfc8f23 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.655156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.655901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.656235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.662355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.665933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.668134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.697822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.708987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1272/2535] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:30.719144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1264/2536] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:30.723355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.734903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba27bbd4-595b-4949-a7ac-23538e8e30fe service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.811506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.812618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.814521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.814866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.817414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:30.875289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:30.944780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1273/2537] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:30 2021] POST /identity/v3/users => generated 282 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:29:30.949208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:30.961774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0de4a9-9a0b-4991-9aae-c8c48b1c2ee1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:30.986929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:30.988049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:30.991576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:30.992145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:30.993038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.088853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc7f41-cbd2-4349-a995-771f37bfaf76 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:31.107314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1265/2538] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:30 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:31.111672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:31.125783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095999d-23c9-466c-a843-3063183f23ae admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:31.142551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:31.143482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.143821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.144153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] PATH_INFO: `/v3/projects/06ff24a599264683a17c04c473928262/users/286e50a7e1534ce4bc96836c9dfa3ca5/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.175638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ff24a599264683a17c04c473928262, user_id=286e50a7e1534ce4bc96836c9dfa3ca5, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.217221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:31.260815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1274/2539] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:31 2021] PUT /identity/v3/projects/06ff24a599264683a17c04c473928262/users/286e50a7e1534ce4bc96836c9dfa3ca5/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:29:31.272541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.272886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.273197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.300077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:31.306231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.409086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] MFA Rules not processed for user `286e50a7e1534ce4bc96836c9dfa3ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:31.410239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.430526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43902bce-8f8e-4e32-871b-3a3ebbc6dc90 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:31.435781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:31.436849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.437190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.437542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] PATH_INFO: `/v3/projects/c7f7a800c99942d1bc361e34668b9207` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.439212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7f7a800c99942d1bc361e34668b9207)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.488898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:31.577019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1266/2540] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:31 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:31.591320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:31.593311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.603432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7f7a800c99942d1bc361e34668b9207', 'request_id': 'req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:31.610870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7f7a800c99942d1bc361e34668b9207', 'request_id': 'req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:31.642353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7f7a800c99942d1bc361e34668b9207', 'request_id': 'req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:31.669458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] The token cache is being invalidate because project c7f7a800c99942d1bc361e34668b9207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:31.669873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:31.670738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-e727fc21-dfdf-47e9-8c79-6e2ca5acf580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:31.672908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1275/2541] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:31 2021] DELETE /identity/v3/projects/c7f7a800c99942d1bc361e34668b9207 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:31.679658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad3e-e43a-44ae-be1e-0e67328c61a4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.680169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad3e-e43a-44ae-be1e-0e67328c61a4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.680799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fad3e-e43a-44ae-be1e-0e67328c61a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.681256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4613f5-03a0-4115-8fd1-4bbd8db94f9d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:31.709536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3e7fad3e-e43a-44ae-be1e-0e67328c61a4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:31.710977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3e7fad3e-e43a-44ae-be1e-0e67328c61a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.746420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:31.747266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.747618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.747958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.749872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.810290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1276/2542] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:31.818803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.819148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.819932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.846246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.873533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:31.874827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.883779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1277/2543] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:31.884862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:31.890676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:31.894027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:31.905739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1267/2544] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:31 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:31.906691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:31.908623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee8180-6553-4261-a4ac-e41a9a9f216a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:31.915435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:31.916520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.916862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.917196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] PATH_INFO: `/v3/projects/6bdcb08d325447d59507e12df3ede633` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.918505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdcb08d325447d59507e12df3ede633)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.918622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b21f6-589d-4c36-bc8b-1e449a31ea42 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:31.923991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:31.924929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:31.925342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:31.925750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:31.927085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:31.927516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:31.960555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:31.964082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:32.010888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1268/2545] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:29:32.016433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:32.027608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338c3fd-fac9-4398-9404-f87e94fc50ea admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:32.032951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:32.033614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:32.034022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:32.034359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:32.035096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:32.048123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdcb08d325447d59507e12df3ede633', 'request_id': 'req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:32.054263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdcb08d325447d59507e12df3ede633', 'request_id': 'req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:32.066781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:32.086992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdcb08d325447d59507e12df3ede633', 'request_id': 'req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:32.107764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] The token cache is being invalidate because project 6bdcb08d325447d59507e12df3ede633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:32.108303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:32.109392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:32.111606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1278/2546] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:31 2021] DELETE /identity/v3/projects/6bdcb08d325447d59507e12df3ede633 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:32.144794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1269/2547] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:32 2021] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:32.146823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:32.149322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:32.247434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9d9fe-e589-4ee3-b03a-9bfa4add9327 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:32.334681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:32.335378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:32.335717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:32.336049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:32.337273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:32.370733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:32.515899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1279/2548] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:32 2021] POST /identity/v3/users => generated 287 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:32.520312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:32.539854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17f2e-6513-4f44-a37e-6c6b22c887d4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:32.554846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:32.555859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:32.556497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:32.557695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:32.558739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:32.628266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452192b-10f3-4d15-bb03-51e9363bdc5e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:32.675747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1270/2549] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:32 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:32.680580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:32.703522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44205a-e20b-4e2f-9ec8-a8a1a46e042a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:32.711833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:32.712905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:32.713914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:32.714323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] PATH_INFO: `/v3/projects/f693eec28c964203b1eb12f62eb1ccb2/users/c83c2760d81c4a02a647a931a4d1e8d5/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:32.740674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f693eec28c964203b1eb12f62eb1ccb2, user_id=c83c2760d81c4a02a647a931a4d1e8d5, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:32.774810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:32.815163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1280/2550] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:32 2021] PUT /identity/v3/projects/f693eec28c964203b1eb12f62eb1ccb2/users/c83c2760d81c4a02a647a931a4d1e8d5/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:32.826822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64670d-2add-48bd-b97b-0987493b7990 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:32.827173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64670d-2add-48bd-b97b-0987493b7990 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:32.827516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64670d-2add-48bd-b97b-0987493b7990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:32.869036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2f64670d-2add-48bd-b97b-0987493b7990 None None] MFA Rules not processed for user `c83c2760d81c4a02a647a931a4d1e8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:32.870516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2f64670d-2add-48bd-b97b-0987493b7990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:32.975080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1271/2551] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:32 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:32.986493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:32.997348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:33.098078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414616cc-ec41-46ea-8869-4a37334af78f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:33.102151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:33.102969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:33.103316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:33.103688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:33.113721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:33.144836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:33.157105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1281/2552] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:32 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:35.284525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:35.284984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:35.285092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:35.321979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:35.323405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:35.396288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1272/2553] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:29:35 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:35.461536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:35.463680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:35.572576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef0786-579b-472c-b981-dde10d0a0286 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:35.581507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:35.583198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:35.583907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:35.584484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:35.600417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:35.631318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb31fc-a659-49a7-bdc6-46f0f81f9796 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:35.642420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1282/2554] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:29:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 12:29:38.251712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:38.391585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa834e-b19a-4604-b7f9-e518158273a4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:38.400366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:38.401331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:38.401840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:38.402194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] PATH_INFO: `/v3/users/c83c2760d81c4a02a647a931a4d1e8d5` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:38.403452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83c2760d81c4a02a647a931a4d1e8d5)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:38.434627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:38.554063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83c2760d81c4a02a647a931a4d1e8d5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:38.580966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83c2760d81c4a02a647a931a4d1e8d5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:38.613318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83c2760d81c4a02a647a931a4d1e8d5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:38.614637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83c2760d81c4a02a647a931a4d1e8d5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:38.634029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83c2760d81c4a02a647a931a4d1e8d5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:38.646521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1273/2555] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:29:38 2021] DELETE /identity/v3/users/c83c2760d81c4a02a647a931a4d1e8d5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:38.651454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:38.651802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:38.652199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:38.718083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:38.719341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:38.858233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1283/2556] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:38.903253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:38.904362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:39.063653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadb461-9880-4c73-9a51-0a3aa7574c4a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:39.071904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:39.072742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:39.072742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:39.072986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:39.096371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:39.131728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0490608-0aca-4c39-90e0-f15c8d489ca8 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:39.144164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1274/2557] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:40.409666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:40.411306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:40.433433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209aef8-3d1b-40a7-a808-3e2047032696 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:40.443523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:40.444644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:40.445435 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:40.445913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] PATH_INFO: `/v3/projects/f693eec28c964203b1eb12f62eb1ccb2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:40.448635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f693eec28c964203b1eb12f62eb1ccb2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:40.516969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:40.625013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f693eec28c964203b1eb12f62eb1ccb2', 'request_id': 'req-19b074aa-db6f-4e85-82d9-d586c695e86c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:40.631423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f693eec28c964203b1eb12f62eb1ccb2', 'request_id': 'req-19b074aa-db6f-4e85-82d9-d586c695e86c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:40.664176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f693eec28c964203b1eb12f62eb1ccb2', 'request_id': 'req-19b074aa-db6f-4e85-82d9-d586c695e86c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:40.714699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] The token cache is being invalidate because project f693eec28c964203b1eb12f62eb1ccb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:29:40.715273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:40.716103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-19b074aa-db6f-4e85-82d9-d586c695e86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:29:40.718121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1284/2558] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:29:40 2021] DELETE /identity/v3/projects/f693eec28c964203b1eb12f62eb1ccb2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:40.724108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:40.724463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:40.724902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:40.754392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:40.755629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:40.846304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1275/2559] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:40.857737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:40.858934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:40.859274 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:40.889635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:40.891131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:40.901856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1285/2560] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:40.905334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:40.921428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ead8c5-d055-4acf-a1b2-765972a0438d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:40.927364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:40.928371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:40.928788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:40.929198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:40.930212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:29:40.930670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:40.963701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:40.980589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1276/2561] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:29:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:29:40.987115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:41.002577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03440b-67ec-47e8-9c05-ea08a22eefaa None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:41.013048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:41.016161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.016733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.017247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.018279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:41.070021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:41.136616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1286/2562] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:29:40 2021] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:41.141212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:41.154639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624f38-fc87-4502-bb54-53d131c3e586 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:41.261345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:41.262132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.262489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.262830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.263705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:41.296042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:41.351829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1277/2563] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:29:41 2021] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:29:41.356010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:41.367096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2dc97-3107-43cd-90b8-deb9f3e6a53d admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:41.376133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:41.376878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.377215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.377593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.378415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:41.413290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324089c3-3ac2-4d5b-9939-f1a5ded89b27 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:41.427826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1287/2564] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:29:41 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:29:41.432764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:41.443271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4e907-5398-4b60-9c67-d43b6242611b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:41.448827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:41.449744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.450128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.450517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] PATH_INFO: `/v3/projects/4bb4aadcfe994809883718507d2361a7/users/094e438919f6451282441f3130ba568a/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.476232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb4aadcfe994809883718507d2361a7, user_id=094e438919f6451282441f3130ba568a, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:41.507996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:41.553218 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1278/2565] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:29:41 2021] PUT /identity/v3/projects/4bb4aadcfe994809883718507d2361a7/users/094e438919f6451282441f3130ba568a/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:29:41.558612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5915-1026-4e7a-92c3-2b3bfece3d29 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.558958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5915-1026-4e7a-92c3-2b3bfece3d29 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.559292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee5915-1026-4e7a-92c3-2b3bfece3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.625339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-15ee5915-1026-4e7a-92c3-2b3bfece3d29 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:41.626608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-15ee5915-1026-4e7a-92c3-2b3bfece3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:41.713910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1288/2566] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:41.721565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:41.723319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:41.815771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095bcd-e6db-490e-a652-24caf1ff092f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:41.823344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:41.824238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:41.824721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:41.825196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:41.854046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:41.884166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:41.896347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1279/2567] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:43.745293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422b89-ecbb-4008-8710-f732ec1df233 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:43.746381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422b89-ecbb-4008-8710-f732ec1df233 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:43.746937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422b89-ecbb-4008-8710-f732ec1df233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:43.866165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5b422b89-ecbb-4008-8710-f732ec1df233 None None] MFA Rules not processed for user `094e438919f6451282441f3130ba568a`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:43.866165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5b422b89-ecbb-4008-8710-f732ec1df233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:43.913584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1289/2568] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:43 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:43.928781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:43.929981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:44.031604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86dd3d-90e9-415e-927d-0105873f6df0 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:44.035593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:44.036255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:44.036597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:44.036930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:44.047711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:44.077676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29bc734-f2bc-4a96-b72f-4c77c478bd6f service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:44.087825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1280/2569] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:43 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:29:47.639302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:47.639771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:47.640071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:47.687519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] MFA Rules not processed for user `094e438919f6451282441f3130ba568a`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:47.689050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:47.704109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1290/2570] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:29:47 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:51.266894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73c93-ad34-4e03-a166-30ecfe780aeb None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:51.267393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73c93-ad34-4e03-a166-30ecfe780aeb None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:51.267564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe73c93-ad34-4e03-a166-30ecfe780aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:51.293511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4fe73c93-ad34-4e03-a166-30ecfe780aeb None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:51.294951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4fe73c93-ad34-4e03-a166-30ecfe780aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:51.384698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1281/2571] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:29:51 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:51.398443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:51.400109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:51.497236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14b9a-37f1-4fd6-8beb-4a271d0756d9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:51.503743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:51.504799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:51.505581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:51.506029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:51.520861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:51.560044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:51.572502 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1291/2572] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:29:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 12:29:53.220757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756ab1-299d-45d7-b0d3-654b52ea73e5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:53.221273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756ab1-299d-45d7-b0d3-654b52ea73e5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:53.221421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3756ab1-299d-45d7-b0d3-654b52ea73e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:53.247862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a3756ab1-299d-45d7-b0d3-654b52ea73e5 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:53.249228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a3756ab1-299d-45d7-b0d3-654b52ea73e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:53.258362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1282/2573] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:29:53 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:29:53.274514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:53.285630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb80bd8-fabe-43f1-83b7-d1d4a814fa19 service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:53.290847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:53.291704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:53.292171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:53.292511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:53.301780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:53.342965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:53.352633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1292/2574] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:29:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:29:54.273358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:54.273883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:54.274020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:54.303927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:29:54.305243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:54.332602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1283/2575] 10.222.0.18 () {58 vars in 958 bytes} [Sat Aug 21 12:29:54 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:29:54.343558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:54.365075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc53bf0-03d9-4773-b829-862753d6b332 service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:54.380344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:54.381382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:54.381734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:54.382159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:54.393817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:54.433973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:54.446192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1293/2576] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:29:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:29:58.820860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:29:58.823088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:58.963874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976373-b97c-42c1-acab-13710d4192c8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:29:58.969262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:29:58.969964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:29:58.970307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:29:58.970640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:29:58.972595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:29:58.985114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:29:59.047204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0611-be65-49ad-86ec-dbdc0501c863 service placement] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:29:59.073777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1284/2577] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:29:58 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:30:00.174782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:00.176284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:00.197334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f90660-90a8-4e53-9cbe-c139f1bf20c7 service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:00.203553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:00.204057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:00.204427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:00.204766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] PATH_INFO: `/v3/users/1c071af3feab43d9aff4ecc3cb097cee` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:00.206138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c071af3feab43d9aff4ecc3cb097cee)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:00.251408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:00.429489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c071af3feab43d9aff4ecc3cb097cee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:00.449757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c071af3feab43d9aff4ecc3cb097cee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:00.504792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c071af3feab43d9aff4ecc3cb097cee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:00.505465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c071af3feab43d9aff4ecc3cb097cee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:00.519715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c071af3feab43d9aff4ecc3cb097cee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:00.526335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1294/2578] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:30:00 2021] DELETE /identity/v3/users/1c071af3feab43d9aff4ecc3cb097cee => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:00.531101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:00.531577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:00.532016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:00.558406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:00.559784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:00.641015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1285/2579] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:00.668288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:00.669893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:00.746739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bd3fd-be69-479d-911f-ea16201fff15 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:00.750770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:00.751541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:00.751968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:00.752371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:00.778982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:00.819917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86236be4-588c-421b-af3c-d947f10e0af1 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:00.832065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1295/2580] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:30:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:30:01.377452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:01.379499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:01.392288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f3414-cc4e-46ec-baf1-dceac27c0e0c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:01.407504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:01.408859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:01.409334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:01.409664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] PATH_INFO: `/v3/projects/04a7ec7ce44b4112857cd427cab069d9` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:01.411030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a7ec7ce44b4112857cd427cab069d9)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:01.444134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:01.535424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a7ec7ce44b4112857cd427cab069d9', 'request_id': 'req-01d26920-c000-47d8-9f6f-52f9bad77a61'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:01.543278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a7ec7ce44b4112857cd427cab069d9', 'request_id': 'req-01d26920-c000-47d8-9f6f-52f9bad77a61'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:01.623269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a7ec7ce44b4112857cd427cab069d9', 'request_id': 'req-01d26920-c000-47d8-9f6f-52f9bad77a61'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:01.642163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] The token cache is being invalidate because project 04a7ec7ce44b4112857cd427cab069d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:30:01.642522 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:01.643286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-01d26920-c000-47d8-9f6f-52f9bad77a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:01.645026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1286/2581] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:30:01 2021] DELETE /identity/v3/projects/04a7ec7ce44b4112857cd427cab069d9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:02.514031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:02.514648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:02.515062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] PATH_INFO: `/` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:02.517279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1296/2582] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:30:02 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:30:02.527101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaab2e-1398-49e0-a478-a4fe8536cef4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:02.527446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaab2e-1398-49e0-a478-a4fe8536cef4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:02.527780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaab2e-1398-49e0-a478-a4fe8536cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:02.588938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4adaab2e-1398-49e0-a478-a4fe8536cef4 None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:02.590383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4adaab2e-1398-49e0-a478-a4fe8536cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:02.663036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1287/2583] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:30:02 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:02.678813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:02.680671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:02.695380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b216f-3093-402c-b26c-0d86a4868249 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:02.699009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:02.699665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:02.700004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:02.700336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:02.708314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:02.736764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:02.746715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1297/2584] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:30:02 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:30:10.588718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:10.589196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:10.589385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:10.614040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:10.615285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:10.685337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1288/2585] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:30:10 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:10.699805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:10.701764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:10.789416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37865b5-54af-4f67-b957-2cf98be015eb service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:10.794498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:10.795162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:10.795507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:10.795844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:10.804739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:10.833943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010638b-cba1-44c6-b7cc-eb8374a8409a service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:10.842745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1298/2586] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:30:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:30:20.159862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:20.162532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:20.260812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d62f6-bc20-4992-8443-93a0d3504504 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:20.266340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:20.267464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:20.274624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:20.275364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] PATH_INFO: `/v3/users/286e50a7e1534ce4bc96836c9dfa3ca5` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:20.276836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] RBAC: Authorizing `identity:delete_user(user_id=286e50a7e1534ce4bc96836c9dfa3ca5)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:20.307121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:20.467312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286e50a7e1534ce4bc96836c9dfa3ca5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:20.475816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286e50a7e1534ce4bc96836c9dfa3ca5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:20.510724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286e50a7e1534ce4bc96836c9dfa3ca5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:20.511507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286e50a7e1534ce4bc96836c9dfa3ca5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:20.528073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286e50a7e1534ce4bc96836c9dfa3ca5'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:20.538270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1289/2587] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:30:20 2021] DELETE /identity/v3/users/286e50a7e1534ce4bc96836c9dfa3ca5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:20.543152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:20.543578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:20.544030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:20.569616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:20.571695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:20.738361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1299/2588] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:30:20.749861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:20.751510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:20.821388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e325c94-af8e-4dbe-a828-496a5197071d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:20.825039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:20.825710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:20.826063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:20.826410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:20.837116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:20.867227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99743d-5f5c-4528-ad0a-af6e11ff28ae service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:20.878923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1290/2589] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:30:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:30:21.646577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:21.648199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:21.663107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fa30f-fa6d-428e-8cf2-0dec32aedc09 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:21.678537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:21.679462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:21.679899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:21.680300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] PATH_INFO: `/v3/projects/06ff24a599264683a17c04c473928262` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:21.683711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ff24a599264683a17c04c473928262)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:21.713239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:21.839455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ff24a599264683a17c04c473928262', 'request_id': 'req-b5d95e99-8455-46cf-9840-cca7413647ea'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:21.845566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ff24a599264683a17c04c473928262', 'request_id': 'req-b5d95e99-8455-46cf-9840-cca7413647ea'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:21.892723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ff24a599264683a17c04c473928262', 'request_id': 'req-b5d95e99-8455-46cf-9840-cca7413647ea'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:21.913204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] The token cache is being invalidate because project 06ff24a599264683a17c04c473928262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:30:21.913541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:21.914426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b5d95e99-8455-46cf-9840-cca7413647ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:30:21.916815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1300/2590] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:30:21 2021] DELETE /identity/v3/projects/06ff24a599264683a17c04c473928262 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:21.923009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:21.928687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:21.928687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:21.948170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:21.949433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:22.042437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1291/2591] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:22.051113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.051700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.052195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.078457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:22.079735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:22.088027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1301/2592] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:22.092543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.103194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda53eb-3951-47b0-9e17-43b79f89034d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.107848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.108531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.108876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.109211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.110032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:30:22.110388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.152248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.155119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1292/2593] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:30:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:30:22.159676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.169644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebd939-a26b-4f2b-9721-b307fd5d0ffb None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.174422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.175291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.175633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.175965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.176705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.206341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.294553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1302/2594] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:30:22 2021] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:30:22.298959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.309510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf211-53a7-4b1f-afaf-aeae34dcc475 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.379337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.380030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.380532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.380700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.381506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.410729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.458410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1293/2595] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:30:22 2021] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:30:22.463195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.473898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ecc53-f80f-422f-b7dc-1774a2a2dbf6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.479070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.479737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.480072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.480402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.481176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.510239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1a77-0718-4b40-baaa-d318cf197f50 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.521241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1303/2596] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:30:22 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:30:22.526239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.536599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671a14-a305-4724-ae71-da9cf3642fce admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.541838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.542735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.543075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.543405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] PATH_INFO: `/v3/projects/7c0722379d3d4d2db7faa647c0e06819/users/1140a3e552794d0892bc7fcb5535c9e2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.563845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0722379d3d4d2db7faa647c0e06819, user_id=1140a3e552794d0892bc7fcb5535c9e2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.593161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.635587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1294/2597] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:30:22 2021] PUT /identity/v3/projects/7c0722379d3d4d2db7faa647c0e06819/users/1140a3e552794d0892bc7fcb5535c9e2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:22.640957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b8f9-4d3e-40c4-96d5-c37d95b670ef None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.641350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b8f9-4d3e-40c4-96d5-c37d95b670ef None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.641690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7b8f9-4d3e-40c4-96d5-c37d95b670ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.666838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d6f7b8f9-4d3e-40c4-96d5-c37d95b670ef None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:22.668003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d6f7b8f9-4d3e-40c4-96d5-c37d95b670ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:22.738504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1304/2598] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:30:22.749278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:22.751191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:22.823800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39cd95-018c-4898-88c5-e5b693b76d0a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:22.827992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:22.828727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:22.829071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:22.829401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:22.839782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:22.869293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c23779-ae5f-4ece-81ee-73ade15e1a24 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:22.880066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1295/2599] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:30:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:30:26.865649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:26.866200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:26.866569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:26.891076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] MFA Rules not processed for user `094e438919f6451282441f3130ba568a`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:26.892394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:26.984080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1305/2600] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:26 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:35.284589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:35.285199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:35.285313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:35.328121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] MFA Rules not processed for user `1140a3e552794d0892bc7fcb5535c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:35.329342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:35.418979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1296/2601] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:35 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:35.423694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:35.437926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acb5f1-4b7c-4449-ab38-7a5c95619b2a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:35.443340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:35.444129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:35.444558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:35.445039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:35.446163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:35.528938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:35.608552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1306/2602] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:30:35 2021] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:30:35.613369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:35.626297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82efb5-ff3e-4670-8db7-40e47a67fb26 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:35.698779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:35.699475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:35.699813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:35.700143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:35.700869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:35.730309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:35.902869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1297/2603] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:30:35 2021] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:30:35.904161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:35.919179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f185ce7-9b65-417e-a518-e31c3aac11ae admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:35.925258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:35.926261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:35.926818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:35.927346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:35.928365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:35.984922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.010379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1307/2604] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:30:35 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:30:36.017096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:36.030524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9cbb-a893-451e-b475-96edf1a36214 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:36.036489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:36.037657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:36.038228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:36.039842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] PATH_INFO: `/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:36.067734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4948701c7e6f47229b4626338aaedc44, user_id=e14db2b0d9aa44249a4320d77a06f47a, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:36.107471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.171506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1298/2605] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:30:36 2021] PUT /identity/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:30:36.174475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:36.198737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04297bb4-5909-4182-b11f-8771fb87430a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:36.340016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:36.340953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:36.341541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:36.342012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:36.343441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:36.394322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.440381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1308/2606] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:30:36 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:30:36.444595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:36.466197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b999b4-36dd-46ff-8b3f-357e2aae1864 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:36.477509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:36.480721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:36.481067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:36.481410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] PATH_INFO: `/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:36.487095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4948701c7e6f47229b4626338aaedc44, user_id=e14db2b0d9aa44249a4320d77a06f47a, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:36.525046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.540967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1299/2607] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:30:36 2021] PUT /identity/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:30:36.545112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:36.558534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9792d-4bd4-4e2c-9fca-775389206752 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:36.661655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:36.662534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:36.662887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:36.663163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:36.663978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:36.692464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda6a83-15bd-4947-94fe-3e18f988cc41 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.705412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1309/2608] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:30:36 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:30:36.709728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:36.722947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259cf33-bf1c-454c-b769-22ff6c8fc3e9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:36.728528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:36.729671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:36.730303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:36.730842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] PATH_INFO: `/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:36.733383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4948701c7e6f47229b4626338aaedc44, user_id=e14db2b0d9aa44249a4320d77a06f47a, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:36.766035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59330bf2-6c74-4c35-8ae3-d76eccdc03e6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:36.807846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1300/2609] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:30:36 2021] PUT /identity/v3/projects/4948701c7e6f47229b4626338aaedc44/users/e14db2b0d9aa44249a4320d77a06f47a/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:30:39.798272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:39.798787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:39.798923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:39.835071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] MFA Rules not processed for user `5a06eed8f2c14bae92ddd44ac02e7114`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:39.836374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:39.914772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1310/2610] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:39 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:41.830744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf3d0-cb2d-4803-a927-60e14737298b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:41.831600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf3d0-cb2d-4803-a927-60e14737298b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:41.832132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cf3d0-cb2d-4803-a927-60e14737298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:41.888635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a25cf3d0-cb2d-4803-a927-60e14737298b None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:41.889961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a25cf3d0-cb2d-4803-a927-60e14737298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:41.972371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1301/2611] 10.222.0.18 () {58 vars in 958 bytes} [Sat Aug 21 12:30:41 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:30:42.022120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:42.023845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:42.160363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf04b05-5412-4845-a4b4-cdef46b5726a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:42.170454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:42.171276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:42.171768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:42.172229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:42.196126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:42.263625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:42.301993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1311/2612] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:30:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:30:48.127997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:48.128456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:48.128687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:48.284807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] MFA Rules not processed for user `e14db2b0d9aa44249a4320d77a06f47a`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:30:48.286229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:48.422691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1302/2613] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:30:48 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:30:48.520446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:30:48.521954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:30:48.771147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56378376-ce3a-41f0-bec0-9ac4fe80c5c0 service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:30:48.778364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:30:48.779162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:30:48.779689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:30:48.780129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:30:48.863759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:30:48.897286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:30:48.921220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1312/2614] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:30:48 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:02.050787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:02.052265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:02.134446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c5c04-0520-4a69-8b32-551f1fc26a72 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:02.138968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:02.139864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:02.140205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:02.140536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] PATH_INFO: `/v3/users/6e43e097c35646c4a7cd85d247b9d398` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:02.141762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e43e097c35646c4a7cd85d247b9d398)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:02.172710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:02.277492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e43e097c35646c4a7cd85d247b9d398'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:02.285758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e43e097c35646c4a7cd85d247b9d398'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:02.313970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e43e097c35646c4a7cd85d247b9d398'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:02.314623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e43e097c35646c4a7cd85d247b9d398'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:02.328807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8b0688ce-48e5-4592-ab6b-a73fbfbd9c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e43e097c35646c4a7cd85d247b9d398'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:02.336573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1303/2615] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:02 2021] DELETE /identity/v3/users/6e43e097c35646c4a7cd85d247b9d398 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:02.878345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:02.889647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8403-6fb8-4629-85eb-0de316f0e952 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:02.957586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:02.958639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:02.959068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:02.959491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] PATH_INFO: `/v3/projects/2306c82a20c54b8cb45c754e26de3439` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:02.961400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2306c82a20c54b8cb45c754e26de3439)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:02.991000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.100639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2306c82a20c54b8cb45c754e26de3439', 'request_id': 'req-0490342f-ec88-401b-8845-8ec5bf77549a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:03.105960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2306c82a20c54b8cb45c754e26de3439', 'request_id': 'req-0490342f-ec88-401b-8845-8ec5bf77549a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:03.177731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2306c82a20c54b8cb45c754e26de3439', 'request_id': 'req-0490342f-ec88-401b-8845-8ec5bf77549a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:03.197654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] The token cache is being invalidate because project 2306c82a20c54b8cb45c754e26de3439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:03.198685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:03.199480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0490342f-ec88-401b-8845-8ec5bf77549a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:03.201341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1313/2616] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:02 2021] DELETE /identity/v3/projects/2306c82a20c54b8cb45c754e26de3439 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:03.207655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.208141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.208575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.240305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:03.242528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:03.331257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1304/2617] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:03.333065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.333414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.333751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.360460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:03.361693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:03.370826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1314/2618] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:03.374985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.385243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e493536-54b2-4f53-83db-0843d626aa50 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.389982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.390658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.391000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.391338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.392129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:31:03.392489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.421369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.436006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1305/2619] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:31:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:31:03.440743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.450439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbeb9c9-89e6-497c-bce1-9459b851f35e None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.455110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.455764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.456098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.456432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.457154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.486147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383727b-3b4d-408b-a36b-5b9c115ec260 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.556923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1315/2620] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:03.561649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.572193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb23a2-6edd-4ae4-bdcd-569f02ba3e5d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.652655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.653948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.653948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.654269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.657763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.686269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.720035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.720385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.720715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.746875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:03.748171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:03.784377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1306/2621] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:03.788565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.798533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821583-66ef-4bb7-8f6f-41400d2100d6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.803149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.804346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.804687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.805030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.806056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.820411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1316/2622] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:31:03.833467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.834661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.834957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:03.847092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1307/2623] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:03 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:31:03.851481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:03.861615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9e2d-b850-4de1-9da6-1b99a59d70b1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.866771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.867669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.868010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.868348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] PATH_INFO: `/v3/projects/175c435e0fbd4553bf4d3df0ecca7df4/users/f604be382adc4e73b2905f0ccc1b938c/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.891114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175c435e0fbd4553bf4d3df0ecca7df4, user_id=f604be382adc4e73b2905f0ccc1b938c, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.916153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776bc64-515b-4d81-9011-5bbcfe9138ae None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:03.920154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fd3f6-7e58-4b01-8d3d-7ece4cb615d0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.921933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:03.922960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.923306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.923957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.933910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:03.955419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1308/2624] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:03 2021] PUT /identity/v3/projects/175c435e0fbd4553bf4d3df0ecca7df4/users/f604be382adc4e73b2905f0ccc1b938c/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:31:03.966024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:03.970298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:03.970684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:03.971032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:03.974559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1317/2625] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:31:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 12:31:04.014032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] MFA Rules not processed for user `f604be382adc4e73b2905f0ccc1b938c`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:04.015211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:04.095677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1309/2626] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:03 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:04.099651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.111662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23272862-926c-4f3f-bf9b-00925ef619bf service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:04.198823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:04.199708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:04.200057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:04.200418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:04.201168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:04.232004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:04.288688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1318/2627] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:04 2021] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:04.293313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.310073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef58b13-8754-4cca-a0e7-fe6f38697f8b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:04.385638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:04.386469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:04.386923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:04.387405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:04.388276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:04.419604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:04.590099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1310/2628] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:04 2021] POST /identity/v3/users => generated 292 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:04.594485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.606298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096c263-fa55-4f29-b018-0da87a3b083c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:04.614302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:04.615342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:04.615926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:04.617097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:04.618144 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:04.653563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:04.673501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1319/2629] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:04.675431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.697689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadceb0-37fd-4a4b-92f2-aea23835caf2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:04.700730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:04.701978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:04.702568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:04.702958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] PATH_INFO: `/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:04.730345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] RBAC: Authorizing `identity:create_grant(project_id=584e88498dd74f74aa388341ed7e3a3b, user_id=ca1cb3374f014ec88abf1da88d3ae14b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:04.763442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:04.830240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1311/2630] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:04 2021] PUT /identity/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:04.834837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.846600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1fe69-21df-44f3-8ff1-a05b1a7e5acd admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:04.919887 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:04.920761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:04.921110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:04.921449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:04.922831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:04.956814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:04.973822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:04.979140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:04.995508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a3d7-2ece-4340-8de1-454f5556081c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:05.001188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:05.002529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:05.004178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:05.004585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] PATH_INFO: `/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:05.007373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584e88498dd74f74aa388341ed7e3a3b, user_id=ca1cb3374f014ec88abf1da88d3ae14b, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:05.043101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:05.057430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1312/2632] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:04 2021] PUT /identity/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:05.062079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:05.074723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f824c42-482e-4bd0-b574-05d98720b9fa admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:05.149399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:05.150042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:05.150345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:05.151124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:05.152064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:05.187369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94e08f-2c0f-4c09-900a-2879ce1b4bec admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:05.200900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1321/2633] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:05 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:05.205569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:05.217545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9ca77-adf2-461b-a530-ab3397715104 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:05.222458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:05.223380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:05.223739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:05.224075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] PATH_INFO: `/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:05.226731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584e88498dd74f74aa388341ed7e3a3b, user_id=ca1cb3374f014ec88abf1da88d3ae14b, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:05.258628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:05.312282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1313/2634] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:05 2021] PUT /identity/v3/projects/584e88498dd74f74aa388341ed7e3a3b/users/ca1cb3374f014ec88abf1da88d3ae14b/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:05.324709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:05.325214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:05.325399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:05.365805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] MFA Rules not processed for user `ca1cb3374f014ec88abf1da88d3ae14b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:05.367112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:05.464478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1322/2635] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:05 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:05.475693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:05.477449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:05.586726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d739-7f7e-41ca-b868-036a0dc563b9 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:05.591291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:05.592187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:05.592530 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:05.593320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:05.606011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:05.634509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4a1ff-56e3-49b5-abb4-c297cb7e4754 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:05.644823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1314/2636] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:05 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:06.287513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:06.380195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f3dc6-461c-4c99-a33d-0580d0c45a11 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:06.385773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:06.386702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:06.387030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:06.387505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] PATH_INFO: `/v3/users/f604be382adc4e73b2905f0ccc1b938c` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:06.388876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f604be382adc4e73b2905f0ccc1b938c)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:06.420133 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:06.530828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f604be382adc4e73b2905f0ccc1b938c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:06.540819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f604be382adc4e73b2905f0ccc1b938c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:06.571682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f604be382adc4e73b2905f0ccc1b938c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:06.572323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f604be382adc4e73b2905f0ccc1b938c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:06.587378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f604be382adc4e73b2905f0ccc1b938c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:06.594601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1323/2637] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:06 2021] DELETE /identity/v3/users/f604be382adc4e73b2905f0ccc1b938c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:06.599437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:06.599806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:06.600149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:06.625507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:06.628494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:06.709213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:06.724070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:06.726487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:06.809475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371809c-a892-4b47-8550-ad9ed31ddeb7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:06.814032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:06.814810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:06.815207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:06.815549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:06.827519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:06.862392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:06.874772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1324/2639] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:07.524408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:07.526583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:07.560927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589a757-c57c-4d9b-b134-c59d87d3ee40 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:07.582359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:07.583925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:07.584539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:07.586339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] PATH_INFO: `/v3/projects/175c435e0fbd4553bf4d3df0ecca7df4` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:07.588486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=175c435e0fbd4553bf4d3df0ecca7df4)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:07.625534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:07.735846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175c435e0fbd4553bf4d3df0ecca7df4', 'request_id': 'req-5d9031e7-da56-45b7-b594-a9c1fad56f8e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:07.743854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175c435e0fbd4553bf4d3df0ecca7df4', 'request_id': 'req-5d9031e7-da56-45b7-b594-a9c1fad56f8e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:07.771955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175c435e0fbd4553bf4d3df0ecca7df4', 'request_id': 'req-5d9031e7-da56-45b7-b594-a9c1fad56f8e'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:07.801376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] The token cache is being invalidate because project 175c435e0fbd4553bf4d3df0ecca7df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:07.802056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:07.802831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:07.806514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1316/2640] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:07 2021] DELETE /identity/v3/projects/175c435e0fbd4553bf4d3df0ecca7df4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:07.810866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:07.824748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d09243-6fbf-4acf-9279-7f6a9bd06ec4 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:07.923688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:07.924845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:07.925352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:07.926186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] PATH_INFO: `/v3/users/ca1cb3374f014ec88abf1da88d3ae14b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:07.927956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1cb3374f014ec88abf1da88d3ae14b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:07.964804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:08.098682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1cb3374f014ec88abf1da88d3ae14b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:08.113263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1cb3374f014ec88abf1da88d3ae14b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:08.166450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1cb3374f014ec88abf1da88d3ae14b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:08.167448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1cb3374f014ec88abf1da88d3ae14b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:08.190737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dfe561b7-4ede-44f9-a6ec-30f58c330c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1cb3374f014ec88abf1da88d3ae14b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:08.205162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1325/2641] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:07 2021] DELETE /identity/v3/users/ca1cb3374f014ec88abf1da88d3ae14b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:08.778403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:08.793448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:08.811416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9031e7-da56-45b7-b594-a9c1fad56f8e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:08.906796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:08.907813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:08.908288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:08.908643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] PATH_INFO: `/v3/projects/584e88498dd74f74aa388341ed7e3a3b` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:08.909930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584e88498dd74f74aa388341ed7e3a3b)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:08.939459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:09.162551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584e88498dd74f74aa388341ed7e3a3b', 'request_id': 'req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:09.168357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584e88498dd74f74aa388341ed7e3a3b', 'request_id': 'req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:09.208718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584e88498dd74f74aa388341ed7e3a3b', 'request_id': 'req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:09.248096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] The token cache is being invalidate because project 584e88498dd74f74aa388341ed7e3a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:09.248598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:09.249492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-660f40d8-c97a-4cd8-ac7e-67f5a891f6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:09.251477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1317/2642] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:08 2021] DELETE /identity/v3/projects/584e88498dd74f74aa388341ed7e3a3b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:09.259689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.260340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.260833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.288680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:09.291776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:09.395760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1326/2643] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:31:09.404158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.404514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.404865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.433140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:09.434867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:09.443068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1318/2644] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:09.448046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:09.458654 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3862c6-149b-4f99-90e3-8d42f4205af2 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:09.464062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:09.464956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.465762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.466131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.466964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:31:09.467246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:09.496772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:09.518245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1327/2645] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:31:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:31:09.519108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:09.532518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0fcf7-3ea5-472c-b6c4-abaaa8367ab9 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:09.537230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:09.537969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.538311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.538638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.539372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:09.567902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:09.654403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1319/2646] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:09 2021] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:31:09.658977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:09.671183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb0379-e415-4590-bec1-2aa113b6b125 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:09.749628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:09.750581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.750874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.751617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.752355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:09.813630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:09.892901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1328/2647] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:09 2021] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:09.894922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:09.921613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447112-6c9e-4b9f-8248-bb98c739e6fa admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:09.928001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:09.930264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:09.931070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:09.931070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:09.932514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:09.968788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9d2df-1116-40a9-b1a0-585b9e9b0238 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:09.986684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1320/2648] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:09 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:09.993004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.025054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf852ba-0d3c-42c5-bd38-b7c4dac293cd admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:10.032364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:10.033621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.034159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.034591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] PATH_INFO: `/v3/projects/758396a55b7545d698fd8f16d90f4e39/users/a0e986d2b59c4f14bae2e24db985ea2b/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.067028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758396a55b7545d698fd8f16d90f4e39, user_id=a0e986d2b59c4f14bae2e24db985ea2b, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:10.105911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:10.150994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1329/2649] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:09 2021] PUT /identity/v3/projects/758396a55b7545d698fd8f16d90f4e39/users/a0e986d2b59c4f14bae2e24db985ea2b/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:31:10.163203 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.163551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.163918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.209516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] MFA Rules not processed for user `a0e986d2b59c4f14bae2e24db985ea2b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:10.211323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:10.311751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1321/2650] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:10 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:10.312711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.392299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d635a-ba96-4991-a9c6-860ff1566315 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:10.401895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:10.402751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.403087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.403417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.404168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:10.435023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:10.503746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1330/2651] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:10 2021] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:10.507955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.521846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f396b-b383-4889-bf84-24d0a5c1329d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:10.602874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:10.603569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.603912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.604249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.604986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:10.634622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:10.705168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1322/2652] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:10 2021] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:10.709118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.721343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9df4b-99cf-4db3-9cb7-91aa4dc85b46 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:10.727151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:10.727992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.728329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.728693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.729566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:10.762895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:10.782567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.785949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1331/2653] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:10 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:10.793846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808462aa-fa3d-4759-bc02-3cacd6f29b25 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:10.800197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:10.801157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:10.801706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:10.802093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] PATH_INFO: `/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:10.828586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99914715b84c0b988f763d63a20525, user_id=a7b9c44813af4b5ea37ade95b96dd1ee, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:10.859971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:10.904870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1323/2654] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:10 2021] PUT /identity/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:10.909571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:10.924145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334ea6a-68d5-4ea0-ade2-a8fe2609ddfb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:11.025873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:11.026598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.026983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.027321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.028061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:11.057262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:11.074425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1332/2655] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:10 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:11.076167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:11.092760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48efa8-586a-4396-ae22-b0d373c9a3f0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:11.100913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:11.102018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.102453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.102890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] PATH_INFO: `/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.105090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99914715b84c0b988f763d63a20525, user_id=a7b9c44813af4b5ea37ade95b96dd1ee, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:11.182068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:11.206110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1324/2656] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:11 2021] PUT /identity/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:11.210938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:11.224926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43907744-fabe-479b-b824-b70e778cad77 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:11.343854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:11.345061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.345407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.345749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.347245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:11.378497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba41d9-023a-474e-b24b-1d984cb86abb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:11.408369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1333/2657] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:11 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:11.410224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:11.426451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559f85c-26d3-4b41-b322-267741ca92f0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:11.440675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:11.442126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.442638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.443253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] PATH_INFO: `/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.446139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc99914715b84c0b988f763d63a20525, user_id=a7b9c44813af4b5ea37ade95b96dd1ee, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:11.514357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:11.555071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1325/2658] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:11 2021] PUT /identity/v3/projects/dc99914715b84c0b988f763d63a20525/users/a7b9c44813af4b5ea37ade95b96dd1ee/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:11.566848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.572818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.572818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.640152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] MFA Rules not processed for user `a7b9c44813af4b5ea37ade95b96dd1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:11.640152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:11.750192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1334/2659] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:11 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:11.763698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:11.766091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:11.840600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e21805-b7ff-4c0e-994c-14a720883c9c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:11.845008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:11.845678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:11.846055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:11.846401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:11.856770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:11.886023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f8fb6-b8de-477a-9336-c6669e7deaa5 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:11.896691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1326/2660] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:11 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:11.968168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:12.061404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a17e4-27a1-4514-b016-6ce5dda84d1c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:12.066455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:12.067476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:12.068008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:12.068286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] PATH_INFO: `/v3/users/a0e986d2b59c4f14bae2e24db985ea2b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:12.070388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e986d2b59c4f14bae2e24db985ea2b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:12.099930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:12.195291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e986d2b59c4f14bae2e24db985ea2b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:12.204956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e986d2b59c4f14bae2e24db985ea2b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:12.246285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e986d2b59c4f14bae2e24db985ea2b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:12.246993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e986d2b59c4f14bae2e24db985ea2b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:12.262564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e986d2b59c4f14bae2e24db985ea2b'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:12.272294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1335/2661] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:11 2021] DELETE /identity/v3/users/a0e986d2b59c4f14bae2e24db985ea2b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:12.274306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:12.274789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:12.275206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:12.300718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:12.301988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:12.392115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1327/2662] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:12.403701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:12.405265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:12.472503 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62ff08-a482-4b61-8591-25059fd28ffa admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:12.476626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:12.477289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:12.477625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:12.477989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:12.487444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:12.516405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:12.526490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1336/2663] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:13.101537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:13.103645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:13.120952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ccfaa-908d-4d27-a916-922a08e9ffa8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:13.126570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:13.127636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:13.127979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:13.128322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] PATH_INFO: `/v3/projects/758396a55b7545d698fd8f16d90f4e39` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:13.129565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=758396a55b7545d698fd8f16d90f4e39)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:13.172005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:13.271207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758396a55b7545d698fd8f16d90f4e39', 'request_id': 'req-6136709b-10dc-43a6-a036-d9cda438de7d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.278563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758396a55b7545d698fd8f16d90f4e39', 'request_id': 'req-6136709b-10dc-43a6-a036-d9cda438de7d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.314563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758396a55b7545d698fd8f16d90f4e39', 'request_id': 'req-6136709b-10dc-43a6-a036-d9cda438de7d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.336596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] The token cache is being invalidate because project 758396a55b7545d698fd8f16d90f4e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:13.337056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.337839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.339637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1328/2664] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:13 2021] DELETE /identity/v3/projects/758396a55b7545d698fd8f16d90f4e39 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:13.345983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:13.359860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2230b6-fd33-442e-81ec-dd8709cd0ef7 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:13.448859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:13.451751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:13.451751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:13.451751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] PATH_INFO: `/v3/users/a7b9c44813af4b5ea37ade95b96dd1ee` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:13.453552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b9c44813af4b5ea37ade95b96dd1ee)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:13.483624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:13.608699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b9c44813af4b5ea37ade95b96dd1ee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.622955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b9c44813af4b5ea37ade95b96dd1ee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.651463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b9c44813af4b5ea37ade95b96dd1ee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.652238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b9c44813af4b5ea37ade95b96dd1ee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.667529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-bec54903-fc26-4864-be7b-fc02cee7a766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b9c44813af4b5ea37ade95b96dd1ee'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:13.676129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1337/2665] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:13 2021] DELETE /identity/v3/users/a7b9c44813af4b5ea37ade95b96dd1ee => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:14.168115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:14.170298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:14.184378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136709b-10dc-43a6-a036-d9cda438de7d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:14.259070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:14.259876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.260216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.260544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] PATH_INFO: `/v3/projects/dc99914715b84c0b988f763d63a20525` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.261777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc99914715b84c0b988f763d63a20525)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:14.292020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:14.381757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc99914715b84c0b988f763d63a20525', 'request_id': 'req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:14.391684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc99914715b84c0b988f763d63a20525', 'request_id': 'req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:14.422946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc99914715b84c0b988f763d63a20525', 'request_id': 'req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:14.442455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] The token cache is being invalidate because project dc99914715b84c0b988f763d63a20525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:14.442787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:14.443630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-0f5c5ce3-1eaf-48e1-bf8d-f0716e4b28db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:14.447207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1329/2666] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:14 2021] DELETE /identity/v3/projects/dc99914715b84c0b988f763d63a20525 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:14.454292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.454631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.454970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.481382 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:14.482689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:14.572453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1338/2667] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:14.574159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.574572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.574867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.603129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:14.604377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:14.616616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1330/2668] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:14.619985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:14.629390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8e16f-644f-4903-8694-42ededc30683 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:14.636312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:14.636312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.636312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.636312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.637303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:31:14.637778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:14.667974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:14.686660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1339/2669] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:31:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:31:14.691200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:14.701689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395916b1-57ed-43e1-8825-65a48afdb86d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:14.710330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:14.710970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.711314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.711647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.712387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:14.743194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:14.805140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1331/2670] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:14 2021] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:14.809418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:14.820371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cb356-f1a2-45fc-97ca-3d0ff502fc6a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:14.906770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:14.907599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:14.910032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:14.910474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:14.911377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:14.952869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:15.004753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1340/2671] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:14 2021] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:15.005210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:15.021553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22559abd-a4db-4860-ac49-1cafa72ade90 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:15.026902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:15.027588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:15.027933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:15.028270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:15.029065 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:15.059591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7091e9-efb8-4688-bf85-1d48e19143a5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:15.073565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1332/2672] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:15 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:15.082627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:15.102801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be087f-a331-4f60-8b34-fe52fe941a73 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:15.110694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:15.112724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:15.113413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:15.114094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] PATH_INFO: `/v3/projects/08a3cf7067d345ef84ce6d54da665192/users/b5099f20c6ed42fd9d40bb3f94d0c092/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:15.142000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a3cf7067d345ef84ce6d54da665192, user_id=b5099f20c6ed42fd9d40bb3f94d0c092, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:15.172276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:15.207115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1341/2673] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:15 2021] PUT /identity/v3/projects/08a3cf7067d345ef84ce6d54da665192/users/b5099f20c6ed42fd9d40bb3f94d0c092/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:15.218604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdca7-b52a-432c-b8a5-b0ef8b8766b9 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:15.218940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdca7-b52a-432c-b8a5-b0ef8b8766b9 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:15.219311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fdca7-b52a-432c-b8a5-b0ef8b8766b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:15.262180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9a7fdca7-b52a-432c-b8a5-b0ef8b8766b9 None None] MFA Rules not processed for user `b5099f20c6ed42fd9d40bb3f94d0c092`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:15.263415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9a7fdca7-b52a-432c-b8a5-b0ef8b8766b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:15.349603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1333/2674] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:15 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:15.363933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:15.366655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:15.438304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d425-0e41-4d83-8030-8f9527d13887 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:15.442169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:15.442888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:15.443252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:15.443638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:15.452701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:15.481190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8bc88-c701-4f7f-846d-ca3d34ec86d5 service glance] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:15.492158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1342/2675] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:15 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:17.479594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:17.480109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:17.480306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:17.504934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] MFA Rules not processed for user `1140a3e552794d0892bc7fcb5535c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:17.506252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:17.577899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1334/2676] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:17 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:29.360717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:29.361167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:29.361383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:29.388058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:29.389438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:29.464515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1343/2677] 10.222.0.18 () {58 vars in 958 bytes} [Sat Aug 21 12:31:29 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:29.478430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:29.479990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:29.566227 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5b08-122a-4e59-ae7c-476fab4186ed None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:29.571753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:29.572419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:29.572773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:29.573107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:29.582393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:29.611685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:29.621681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1335/2678] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:31:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:31:32.982421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:32.988898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:33.075282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64f491-ad63-4e81-bdc7-88e7489fa198 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:33.080815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:33.080950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:33.081279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:33.081623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] PATH_INFO: `/v3/users/094e438919f6451282441f3130ba568a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:33.082915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=094e438919f6451282441f3130ba568a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:33.114862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:33.238111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094e438919f6451282441f3130ba568a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.247154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094e438919f6451282441f3130ba568a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.279942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094e438919f6451282441f3130ba568a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.280612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094e438919f6451282441f3130ba568a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.294280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce8ab110-a747-4c4a-b8b1-f14a7faec66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094e438919f6451282441f3130ba568a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.300595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1344/2679] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:31:32 2021] DELETE /identity/v3/users/094e438919f6451282441f3130ba568a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:33.626914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:33.639099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a797d9-fa24-42ad-ab89-d386c31950c4 service swift] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:33.727383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:33.728755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:33.729254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:33.729590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] PATH_INFO: `/v3/projects/4bb4aadcfe994809883718507d2361a7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:33.730873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb4aadcfe994809883718507d2361a7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:33.762380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:33.854051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb4aadcfe994809883718507d2361a7', 'request_id': 'req-1ab76e89-4aba-43be-8117-cb7aa8555d94'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.859960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb4aadcfe994809883718507d2361a7', 'request_id': 'req-1ab76e89-4aba-43be-8117-cb7aa8555d94'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.884943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb4aadcfe994809883718507d2361a7', 'request_id': 'req-1ab76e89-4aba-43be-8117-cb7aa8555d94'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.903908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] The token cache is being invalidate because project 4bb4aadcfe994809883718507d2361a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:31:33.904244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.904960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1ab76e89-4aba-43be-8117-cb7aa8555d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:31:33.906899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1336/2680] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:31:33 2021] DELETE /identity/v3/projects/4bb4aadcfe994809883718507d2361a7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:33.912943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:33.913293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:33.913632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:33.939867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:33.941098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:34.025690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1345/2681] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:34.034756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.035196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.035603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.060018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:34.061325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:34.069264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1337/2682] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:34.074214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.084167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83c49-3596-48d0-9368-1042c9e4f335 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.089254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.090048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.090468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.090867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.091716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:31:34.092135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.120253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.134815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1346/2683] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:31:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:31:34.139584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.149826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb07c67-7b48-490d-aff4-e5a547499cd0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.154500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.155245 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.155658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.156314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.157139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.186311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.241953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1338/2684] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:31:34 2021] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:31:34.246443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.257009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ff0b-93a0-48e4-a83d-0c78038866a1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.329646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.330577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.331075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.331566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.332557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.361774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.418388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1347/2685] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:31:34 2021] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:31:34.423095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.434196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bec759-fbcf-4df2-b170-c4ac8a6c2d2f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.438818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.439493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.439835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.440170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.440959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.469673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff530-f578-456a-b6b2-597da1d9d21c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.481488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1339/2686] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:31:34 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:31:34.485766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.496900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecfc0-ec28-4858-89f1-730253370dfb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.501827 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.502749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.503090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.503549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] PATH_INFO: `/v3/projects/ead32593da4441bf9088d7bebb0d899d/users/a6256a3d9a044fe9b42bb5f4c6769c8c/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.526817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead32593da4441bf9088d7bebb0d899d, user_id=a6256a3d9a044fe9b42bb5f4c6769c8c, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.561073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.599933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1348/2687] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:31:34 2021] PUT /identity/v3/projects/ead32593da4441bf9088d7bebb0d899d/users/a6256a3d9a044fe9b42bb5f4c6769c8c/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:31:34.658704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.659049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.659390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.699246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] MFA Rules not processed for user `a6256a3d9a044fe9b42bb5f4c6769c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:34.700477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:34.778368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1340/2688] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:34 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:31:34.788949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:34.791371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:34.860209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5766b-9de0-4082-bfaa-73e4cc9721cb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:34.863900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:34.864562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:34.864903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:34.865235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:34.874358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:34.903428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93299214-3921-46f6-983f-c634fe3a375c service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:34.913671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1349/2689] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:34 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:44.359003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:31:44.360467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:44.428490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82c97-bb16-4d09-97b6-fe00ba7db7d5 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:31:44.432628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:31:44.433512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:44.433909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:44.434249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:44.436113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:44.509633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:31:44.537796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:31:44.548204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1341/2690] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:31:44 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:31:59.347079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:31:59.348422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:31:59.349067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:31:59.379902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] MFA Rules not processed for user `69507673906f416b8ef8befb0e240329`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:31:59.381588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:31:59.454989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1350/2691] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:31:59 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:04.084956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:04.087120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:04.098452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daeae0-71bc-46e8-9fc0-16296ee71d70 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:04.102619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:04.103367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:04.103603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:04.103913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:04.105727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:04.203510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:04.232792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5bf81-5d1d-46cb-ba55-9c464357261e service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:04.246567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1342/2692] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:05.052761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:05.130575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d74ac-10ef-43b1-9876-bc8ef23c877a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:05.135298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:05.136217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:05.136531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:05.136868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] PATH_INFO: `/v3/users/a6256a3d9a044fe9b42bb5f4c6769c8c` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:05.138877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6256a3d9a044fe9b42bb5f4c6769c8c)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:05.169668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:05.302014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6256a3d9a044fe9b42bb5f4c6769c8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:05.311333 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6256a3d9a044fe9b42bb5f4c6769c8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:05.376304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6256a3d9a044fe9b42bb5f4c6769c8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:05.377197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6256a3d9a044fe9b42bb5f4c6769c8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:05.393233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6256a3d9a044fe9b42bb5f4c6769c8c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:05.400754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1351/2693] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:32:05 2021] DELETE /identity/v3/users/a6256a3d9a044fe9b42bb5f4c6769c8c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:05.405765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:05.406151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:05.406491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:05.444386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:05.445820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:05.520717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1343/2694] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:05.536467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:05.537944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:05.538110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:05.539939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:05.612055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b016d-dffe-4f50-9810-11ada4ab0510 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:05.617097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:05.617358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6bf67-dea0-45ee-84c4-26dc1ff871d1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:05.617766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:05.618272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:05.618612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:05.620860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:05.622339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:05.623099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:05.623397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:05.629604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:05.634931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:05.664947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:05.676106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1344/2695] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:05.718925 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:05.761871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:05.775140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1352/2696] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:05 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:06.532874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:06.534501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:06.548265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059a991-66e3-43b5-af0e-ce281747e973 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:06.553461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:06.554258 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:06.554629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:06.554961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] PATH_INFO: `/v3/projects/ead32593da4441bf9088d7bebb0d899d` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:06.556205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead32593da4441bf9088d7bebb0d899d)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:06.586735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:06.680412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead32593da4441bf9088d7bebb0d899d', 'request_id': 'req-b8c3e193-b168-43b2-93f1-83f7703e436d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:06.686781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead32593da4441bf9088d7bebb0d899d', 'request_id': 'req-b8c3e193-b168-43b2-93f1-83f7703e436d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:06.730552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead32593da4441bf9088d7bebb0d899d', 'request_id': 'req-b8c3e193-b168-43b2-93f1-83f7703e436d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:06.756217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] The token cache is being invalidate because project ead32593da4441bf9088d7bebb0d899d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:32:06.756607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:06.757962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b8c3e193-b168-43b2-93f1-83f7703e436d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:06.759646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1345/2697] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:32:06 2021] DELETE /identity/v3/projects/ead32593da4441bf9088d7bebb0d899d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:09.692087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:09.693526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:09.707770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea8114-f929-49d1-93a0-1c5b21004758 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:09.778478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:09.779384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:09.779723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:09.780056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] PATH_INFO: `/v3/users/b5099f20c6ed42fd9d40bb3f94d0c092` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:09.781541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5099f20c6ed42fd9d40bb3f94d0c092)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:09.811514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:09.916499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5099f20c6ed42fd9d40bb3f94d0c092'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:09.924845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5099f20c6ed42fd9d40bb3f94d0c092'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:09.953086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5099f20c6ed42fd9d40bb3f94d0c092'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:09.953576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5099f20c6ed42fd9d40bb3f94d0c092'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:09.967605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5099f20c6ed42fd9d40bb3f94d0c092'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:09.977650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1353/2698] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:32:09 2021] DELETE /identity/v3/users/b5099f20c6ed42fd9d40bb3f94d0c092 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:09.979413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:09.979833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:09.980252 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.006721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:10.008613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:10.082210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1346/2699] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:10.100410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:10.102498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:10.171742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b9ae1-e004-4e5c-a6c2-877b218b88ed admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:10.175815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:10.176445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:10.176782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:10.177112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.187186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:10.214980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401b3db-f571-4a94-b0ef-8004618608da service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:10.225476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1354/2700] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:10.625677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:10.627189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:10.640565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fe95-1f5b-40a9-94fc-90ca47d39a14 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:10.645064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:10.646013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:10.646353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:10.646683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] PATH_INFO: `/v3/projects/08a3cf7067d345ef84ce6d54da665192` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.647880 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a3cf7067d345ef84ce6d54da665192)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:10.676221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:10.747885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a3cf7067d345ef84ce6d54da665192', 'request_id': 'req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:10.753086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a3cf7067d345ef84ce6d54da665192', 'request_id': 'req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:10.786815 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a3cf7067d345ef84ce6d54da665192', 'request_id': 'req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:10.804670 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] The token cache is being invalidate because project 08a3cf7067d345ef84ce6d54da665192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:32:10.804995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:10.805695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-438783c5-ef3a-4c75-82fc-1c46fe4b3ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:10.807259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1347/2701] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:32:10 2021] DELETE /identity/v3/projects/08a3cf7067d345ef84ce6d54da665192 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:10.813158 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:10.813501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:10.813850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.839012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:10.840214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:10.907314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1355/2702] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:10.916415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:10.916763 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:10.917103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.940746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:10.941991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:10.950777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1348/2703] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:10.955557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:10.967114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46504f-b7f6-43b0-ad63-d839c56f1af6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:10.975616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:10.976304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:10.976650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:10.976990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:10.977776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:32:10.978159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.008328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.023841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1356/2704] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:32:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:32:11.027974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:11.037892 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fddefc-8eed-40bf-ac62-f6981612bc5b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:11.042592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:11.043257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.043595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.043930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.044671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.073819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.143081 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1349/2705] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:32:11 2021] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:11.148388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:11.159572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fb6d1-95c7-4143-9e8a-dce24a3263d5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:11.225175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:11.225840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.226162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.226496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.227217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.256102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.305878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1357/2706] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:32:11 2021] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:11.307059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:11.317929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3460a8-63e2-4858-8e1a-cdc04d4d90ca admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:11.323486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:11.324193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.325708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.326100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.326898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.355494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ddbb55-0ecb-47b5-b95a-ebc0b0f0573b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.371557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1350/2707] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:32:11 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:32:11.372938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:11.383905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd72f5-abfc-4490-b2de-a721d33392ac admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:11.389411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:11.390487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.390904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.391409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] PATH_INFO: `/v3/projects/f4c76e7885b74a3b8ddd04c722cd730e/users/46df987390a6485ca3c64108a4535774/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.414673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c76e7885b74a3b8ddd04c722cd730e, user_id=46df987390a6485ca3c64108a4535774, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.448508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.518275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1358/2708] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:32:11 2021] PUT /identity/v3/projects/f4c76e7885b74a3b8ddd04c722cd730e/users/46df987390a6485ca3c64108a4535774/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:11.528096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.528096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.528096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.568778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] MFA Rules not processed for user `46df987390a6485ca3c64108a4535774`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:11.570189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:11.652400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1351/2709] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:11 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:11.663899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:11.674802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:11.747567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe83ef9-54b8-402c-8307-d622c2e5f396 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:11.752431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:11.753623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:11.754157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:11.754667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:11.764927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:11.796098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77c093-bdac-4e77-bf7e-8af003b925dc service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:11.807058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1359/2710] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:11 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:14.901638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:14.993151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb46cbd0-97db-45f0-b763-2392d878b628 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:14.998270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:14.999359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:14.999845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:15.000364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] PATH_INFO: `/v3/users/46df987390a6485ca3c64108a4535774` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:15.002031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46df987390a6485ca3c64108a4535774)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:15.034954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:15.202438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46df987390a6485ca3c64108a4535774'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:15.210983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46df987390a6485ca3c64108a4535774'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:15.244172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46df987390a6485ca3c64108a4535774'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:15.244843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46df987390a6485ca3c64108a4535774'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:15.258570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46df987390a6485ca3c64108a4535774'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:15.265179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1352/2711] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:32:14 2021] DELETE /identity/v3/users/46df987390a6485ca3c64108a4535774 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:15.270004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:15.270379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:15.270816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:15.330849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:15.332108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:15.410311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1360/2712] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:15.422941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:15.424463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:15.497384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd915b9-bf5a-4793-a583-b5c163be7201 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:15.501461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:15.502190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:15.502540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:15.502914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:15.513626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:15.543234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:15.553778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1353/2713] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:15.743939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:15.745546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:15.758595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b455981-9cdc-4e3e-90cf-68f98ed52f48 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:15.763433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:15.764328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:15.764668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:15.765139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] PATH_INFO: `/v3/users/5a06eed8f2c14bae92ddd44ac02e7114` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:15.766397 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a06eed8f2c14bae92ddd44ac02e7114)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:15.798562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:16.016798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a06eed8f2c14bae92ddd44ac02e7114'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.033535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a06eed8f2c14bae92ddd44ac02e7114'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.067095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a06eed8f2c14bae92ddd44ac02e7114'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.067849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a06eed8f2c14bae92ddd44ac02e7114'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.083903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6a97a1c5-bbd7-4290-abcd-6175ceada5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a06eed8f2c14bae92ddd44ac02e7114'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.096523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1361/2714] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:32:15 2021] DELETE /identity/v3/users/5a06eed8f2c14bae92ddd44ac02e7114 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:16.234521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:16.243013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:16.265572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cac751-9e29-429a-9835-4d8d3a2d87a6 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:16.340340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:16.341232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.341569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.341932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] PATH_INFO: `/v3/projects/f4c76e7885b74a3b8ddd04c722cd730e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.343160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c76e7885b74a3b8ddd04c722cd730e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:16.371836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:16.455947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c76e7885b74a3b8ddd04c722cd730e', 'request_id': 'req-f0df17b6-006b-41d7-b6a6-9c3426345c8a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.463698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c76e7885b74a3b8ddd04c722cd730e', 'request_id': 'req-f0df17b6-006b-41d7-b6a6-9c3426345c8a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.496468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c76e7885b74a3b8ddd04c722cd730e', 'request_id': 'req-f0df17b6-006b-41d7-b6a6-9c3426345c8a'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.516221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] The token cache is being invalidate because project f4c76e7885b74a3b8ddd04c722cd730e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:32:16.516558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.517343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0df17b6-006b-41d7-b6a6-9c3426345c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.519185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1354/2715] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:32:16 2021] DELETE /identity/v3/projects/f4c76e7885b74a3b8ddd04c722cd730e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:16.527033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.527386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.527726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.552038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:16.553312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:16.627302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1362/2716] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:16.636343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.636694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.637109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.652073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:16.654454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:16.667146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:16.668456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:16.676737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3633-c14e-4e20-95c9-d18e0797f5f9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:16.678038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1355/2717] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:16.684721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:16.690448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:16.692092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.693175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.693175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] PATH_INFO: `/v3/projects/e1fa186996244cee8cacdb33875babf1` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.697285 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fa186996244cee8cacdb33875babf1)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:16.697944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb5918-388d-42b1-af73-e6e09fc8de18 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:16.703119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:16.703867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.704774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.704774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.705708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:32:16.706359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:16.738746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:16.756134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1356/2718] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:32:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:32:16.759383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:16.763582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:16.783424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4513471-7191-4b7e-a586-6f1821095aee admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:16.792059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:16.793278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:16.794273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:16.794897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:16.796331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:16.844978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fa186996244cee8cacdb33875babf1', 'request_id': 'req-ce9b86cb-e988-4f02-bb68-e3628178cfd2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.851242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fa186996244cee8cacdb33875babf1', 'request_id': 'req-ce9b86cb-e988-4f02-bb68-e3628178cfd2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.860553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:16.890324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fa186996244cee8cacdb33875babf1', 'request_id': 'req-ce9b86cb-e988-4f02-bb68-e3628178cfd2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.910449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] The token cache is being invalidate because project e1fa186996244cee8cacdb33875babf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:32:16.910699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.911392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:32:16.913527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1363/2719] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:32:16 2021] DELETE /identity/v3/projects/e1fa186996244cee8cacdb33875babf1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:16.919138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1357/2720] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:32:16 2021] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:16.937115 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:16.939294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:17.108080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b86cb-e988-4f02-bb68-e3628178cfd2 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:17.187674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:17.188514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:17.188932 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:17.189338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:17.190180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:17.222249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:17.275303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1364/2721] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:32:16 2021] POST /identity/v3/users => generated 286 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:17.279973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:17.292377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad1db8-35e9-4670-b434-48d1e2896449 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:17.297181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:17.297912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:17.298300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:17.298640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:17.299441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:17.328341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001a2e8-6643-408a-b670-dc4cdd0a9e42 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:17.341598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1358/2722] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:32:17 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:32:17.346005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:17.357017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b5665-5070-456d-9141-f8ed5a845d43 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:17.364673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:17.365816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:17.366390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:17.367171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] PATH_INFO: `/v3/projects/d1f4b0c579c548ad8f6cdef61c56b13a/users/8bfaff746ba147c189999b23de62a49d/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:17.391544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f4b0c579c548ad8f6cdef61c56b13a, user_id=8bfaff746ba147c189999b23de62a49d, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:17.422760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:17.457047 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1365/2723] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:32:17 2021] PUT /identity/v3/projects/d1f4b0c579c548ad8f6cdef61c56b13a/users/8bfaff746ba147c189999b23de62a49d/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:17.463163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:17.463515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:17.463855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:17.490415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:17.491684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:17.564193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1359/2724] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:17.575926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:17.577716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:17.650221 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9044-a223-4709-b492-43cd46bf36cb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:17.654031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:17.654739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:17.655342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:17.655680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:17.666743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:17.695561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2b9cc-1f22-448f-b0bb-3186141eb4a0 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:17.706743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1366/2725] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:22.287208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:22.289184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:22.388575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17baf92d-4aaa-4730-b2ac-77d1a435b35e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:22.394366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:22.395075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:22.395419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:22.395944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:22.398373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:22.488234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:22.538672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:22.550323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1360/2726] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:22 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:26.195735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.196220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.196402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.234035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] MFA Rules not processed for user `8bfaff746ba147c189999b23de62a49d`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:26.235276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:26.312559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1367/2727] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:26 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:26.317292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.328290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2e6f1-7372-4b28-87dc-d69c81242c01 service nova] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.332784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.333441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.333780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.334157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.335429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.364178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.423979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1361/2728] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:32:26 2021] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:26.428311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.439267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ab534-4ce4-4405-971d-1321d2a622e5 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.522537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.523239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.523563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.523899 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.524631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.554388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.601822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1368/2729] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:32:26 2021] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:32:26.604051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.614781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05d661-c99c-4663-88a4-c270a94872ff admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.625937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.629231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.629231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.629231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.629231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.657735 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.672753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1362/2730] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:32:26 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:32:26.674112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.684935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5e732-283e-4e65-8ac7-8a5dc611a1fc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.689952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.690868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.691212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.691544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] PATH_INFO: `/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.723761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0df3fe177eb415495982ae0315fa667, user_id=258657942f4e4375b9a241ed57999b92, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.761310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.793965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1369/2731] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:32:26 2021] PUT /identity/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:26.798602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.810579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac5f91-361c-44c9-9b74-4bd1be04f106 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.882757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.883547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.883968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.884436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.885286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.914929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.930341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1363/2732] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:32:26 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:32:26.931588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:26.942234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c5940-9b0f-41f8-9440-05a4a04a043e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:26.947391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:26.948302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:26.948649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:26.948981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] PATH_INFO: `/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:26.951102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0df3fe177eb415495982ae0315fa667, user_id=258657942f4e4375b9a241ed57999b92, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:26.980518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:26.993182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1370/2733] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:32:26 2021] PUT /identity/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:32:26.997339 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:27.008217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058805-3bab-4ff0-9f1a-b822aad671bb admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:27.079755 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:27.080444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:27.080788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:27.081194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:27.082011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:27.110051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7913528-c163-43db-9a18-902c4f736059 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:27.122320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1364/2734] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:32:26 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:32:27.126592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:27.138459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8f817-7bdc-43bd-991c-1b7c16bc2986 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:27.143273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:27.144739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:27.145072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:27.145504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] PATH_INFO: `/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:27.151124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0df3fe177eb415495982ae0315fa667, user_id=258657942f4e4375b9a241ed57999b92, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:27.181289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:27.236673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1371/2735] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:32:27 2021] PUT /identity/v3/projects/e0df3fe177eb415495982ae0315fa667/users/258657942f4e4375b9a241ed57999b92/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:32:27.405056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:27.405411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:27.405749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:27.430715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] MFA Rules not processed for user `8b6165455d13434895121c88ea45e312`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:27.432169 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:27.505419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1365/2736] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:27 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:29.413798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:29.415999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:29.548917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b4a07-78bf-445a-9a4f-cc9f453e0297 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:29.554038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:29.554857 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:29.555193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:29.555529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:29.557470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:29.584390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:29.614750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:29.627947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1372/2737] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:29 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:29.799714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:29.801256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:29.836156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550b9ac-8586-49f7-ac66-50795121c4a2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:29.843079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:29.843757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:29.844100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:29.844436 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:29.846376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:29.890831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:29.952300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:29.978649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1366/2738] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:29 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:31.058803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:31.066288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:31.213545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6ed6b-f57c-43a5-a9d9-7c4a6b3ab042 service placement] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:31.219644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:31.220321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:31.222083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:31.222083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:31.222853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:31.298771 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:31.328577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aad06-c1e7-4184-9116-3f4798406867 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:31.339674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1373/2739] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:31 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:33.396040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:33.485640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cbcc8-5d74-447d-9500-6bf7c3126440 service placement] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:33.490113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:33.490841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:33.491174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:33.491691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:33.494177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:33.506926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:33.538858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:33.556150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1367/2740] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:33 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:34.943425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:34.944400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:34.944599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:34.990402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] MFA Rules not processed for user `258657942f4e4375b9a241ed57999b92`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:34.991830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:35.097608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1374/2741] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:34 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:35.103374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:35.128265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:35.136138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e618e-73b4-4351-a5a9-71d04e27f3cc service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:35.149529 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd427-8f41-4d2b-befd-a3b54d840619 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:35.151091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:35.151765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:35.152100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:35.152434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:35.158968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:35.164428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:35.165095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:35.165434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:35.165768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:35.177681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:35.209941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312e067-9718-4960-8543-6cd2a8fbe474 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:35.228916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1368/2742] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:35 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:35.267022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:35.297656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:35.309074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1375/2743] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:35 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:38.083159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:38.083656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:38.083817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:38.107681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] MFA Rules not processed for user `8bfaff746ba147c189999b23de62a49d`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:32:38.108884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:38.115549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1369/2744] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:32:38 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:32:41.850496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:41.861531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34777f5-e5af-4f81-82f0-74c99c8c1af0 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:41.868163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:41.868845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:41.869220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:41.869580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:41.872664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:41.887675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:41.917368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261c4f1-d6a2-4b6e-ac24-3414ec226224 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:41.928922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1376/2745] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:41 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:32:56.035767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:32:56.046490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2ce53-8094-45c4-93ae-31070b5c104f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:32:56.050187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:32:56.050839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:32:56.051178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:32:56.051512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:32:56.053372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:32:56.063353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:32:56.092485 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:32:56.101119 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1370/2746] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:32:56 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:33:14.149095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:14.149597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:14.149952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:14.175283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:33:14.176629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:14.243915 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1377/2747] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:33:14 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:33:14.373907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:33:14.375362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:14.454091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f9761-72fd-4479-9cc9-8f7dbc6f4a18 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:33:14.459107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:33:14.459757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:14.460098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:14.460437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:14.468866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:33:14.497818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb41d9-6100-4199-b6f1-75c14e0b9c1a service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:33:14.506743 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1371/2748] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:33:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:33:15.538004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:33:15.550367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654d1ce-344d-424e-8035-7f38d239124a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:33:15.554254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:33:15.555042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:15.555498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:15.556083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:15.568472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:33:15.598597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58434165-0574-41ac-9698-c44284a887b6 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:33:15.610989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1378/2749] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:33:15 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:33:31.217055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749315-47c8-4ae1-8bbe-f438ce785104 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:31.217636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749315-47c8-4ae1-8bbe-f438ce785104 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:31.217757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65749315-47c8-4ae1-8bbe-f438ce785104 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:31.219592 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1372/2750] 10.222.0.18 () {54 vars in 910 bytes} [Sat Aug 21 12:33:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:33:31.224884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc09f2-1955-46a4-b682-1b124a3ab4bc None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:31.225316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc09f2-1955-46a4-b682-1b124a3ab4bc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:31.225728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc09f2-1955-46a4-b682-1b124a3ab4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:31.253076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-00cc09f2-1955-46a4-b682-1b124a3ab4bc None None] MFA Rules not processed for user `294019491b31446c8f92c072f351de93`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:33:31.254341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-00cc09f2-1955-46a4-b682-1b124a3ab4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:31.261369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1379/2751] 10.222.0.18 () {58 vars in 1008 bytes} [Sat Aug 21 12:33:31 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:33:31.274167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65749315-47c8-4ae1-8bbe-f438ce785104 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:33:31.285642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65749315-47c8-4ae1-8bbe-f438ce785104 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:33:31.289340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:33:31.290023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:31.290364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:31.290694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:31.298234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:33:31.327207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:33:31.335477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1373/2752] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:33:31 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:33:33.686400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1f34-b1f3-4567-a896-6a2676f60b65 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:33.686870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1f34-b1f3-4567-a896-6a2676f60b65 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:33.687062 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779c1f34-b1f3-4567-a896-6a2676f60b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:33.794238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-779c1f34-b1f3-4567-a896-6a2676f60b65 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:33:33.795437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-779c1f34-b1f3-4567-a896-6a2676f60b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:33.802805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1380/2753] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:33:33 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:33:33.815909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:33:33.828972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec68c7-291f-4103-a2f9-0e6defcd65ae service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:33:33.834872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:33:33.835565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:33.835907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:33.836239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:33.845543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:33:33.874073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:33:33.884697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1374/2754] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:33:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:33:51.484387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41152-158c-4702-9e61-083d43f1d98e None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:51.484877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41152-158c-4702-9e61-083d43f1d98e None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:51.485132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c41152-158c-4702-9e61-083d43f1d98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:51.511624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a8c41152-158c-4702-9e61-083d43f1d98e None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:33:51.513224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a8c41152-158c-4702-9e61-083d43f1d98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:51.520325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1381/2755] 10.222.0.18 () {58 vars in 958 bytes} [Sat Aug 21 12:33:51 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:33:51.534342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:33:51.545284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83282a-8cb2-4c5a-9983-5cb311e08730 service swift] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:33:51.550875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:33:51.551831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:51.552767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:51.553181 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:51.563068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:33:51.594549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:33:51.604207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1375/2756] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:33:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:33:52.218709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:33:52.219334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:33:52.219824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:33:52.243909 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] MFA Rules not processed for user `1140a3e552794d0892bc7fcb5535c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:33:52.245189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:33:52.312648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1382/2757] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:33:52 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:28.234926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:28.245060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262e8c-b957-474c-9ebb-900cad74624c service swift] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:28.248673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:28.249313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:28.249651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:28.250011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:28.251830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:28.329183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:28.357991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:28.368566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1376/2758] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:36.366231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:36.367692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:36.381186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9f64-62d3-487f-9c2f-f91ff680e577 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:36.385685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:36.386596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:36.386939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:36.387268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] PATH_INFO: `/v3/users/8b6165455d13434895121c88ea45e312` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:36.388469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6165455d13434895121c88ea45e312)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:36.418108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:36.517737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6165455d13434895121c88ea45e312'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:36.526437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6165455d13434895121c88ea45e312'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:36.561579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6165455d13434895121c88ea45e312'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:36.562261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6165455d13434895121c88ea45e312'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:36.575498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-420cefa7-c879-43c3-9940-601ccea48345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6165455d13434895121c88ea45e312'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:36.581920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1383/2759] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:34:36 2021] DELETE /identity/v3/users/8b6165455d13434895121c88ea45e312 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:36.845347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:36.855886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8e810-65ed-463e-aa0b-01e0b694cf54 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:36.923819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:36.924712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:36.925054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:36.925392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] PATH_INFO: `/v3/projects/8a85bc1c655148b88b864390d8aa1fe7` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:36.927215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a85bc1c655148b88b864390d8aa1fe7)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:36.958462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.044653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a85bc1c655148b88b864390d8aa1fe7', 'request_id': 'req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:37.050026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a85bc1c655148b88b864390d8aa1fe7', 'request_id': 'req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:37.081865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a85bc1c655148b88b864390d8aa1fe7', 'request_id': 'req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:37.100314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] The token cache is being invalidate because project 8a85bc1c655148b88b864390d8aa1fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:34:37.100655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:37.101468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:37.103094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1377/2760] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:34:36 2021] DELETE /identity/v3/projects/8a85bc1c655148b88b864390d8aa1fe7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:37.109742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adfa0a-f563-42e2-9d86-47aa03f32bab None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.110129 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adfa0a-f563-42e2-9d86-47aa03f32bab None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.110452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adfa0a-f563-42e2-9d86-47aa03f32bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.111350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.112772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.134161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-89adfa0a-f563-42e2-9d86-47aa03f32bab None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:37.135377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-89adfa0a-f563-42e2-9d86-47aa03f32bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.180394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ebcb2-603d-4f27-a4a9-d714483acc4d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.183976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.184638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.184979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.185315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.187153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.204448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1384/2761] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:37.213295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.213637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.214022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.237555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:37.238834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.246633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1385/2762] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:34:37.250848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.260188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e39f7-7665-4799-98d4-b212812769f1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.261381 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.264938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.265605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.266003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.266336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.267116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:34:37.267459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.291096 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.296607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.301619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1378/2763] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:34:37.310985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1386/2764] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:34:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 12:34:37.315351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.325106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a0aff-be98-4e8a-8272-4401efeec9d2 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.329682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.330375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.330714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.331045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.331776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.361137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.450070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1379/2765] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:34:37 2021] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:37.454570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.464740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af618a-a338-4c64-bfc7-fe23d8853bb8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.533987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.534707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.535044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.535372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.536587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.565517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.603050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1387/2766] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:34:37 2021] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:37.607615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.618890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86950540-a4cb-47b1-9076-99d315bb7ae4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.623621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.624408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.624750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.625146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.626040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.654572 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bc4b3-f423-43a5-a4ff-c1935b80c3c0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.666557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1380/2767] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:34:37 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:34:37.670958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.682050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92763c0-9c4a-4c7f-aeae-efa91dd02fca admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.686766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.687673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.688014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.688347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] PATH_INFO: `/v3/projects/9e690f3fcdbd49028c80eb54b33f480e/users/dfc0a1e7b78a4ad887de9753f37d342d/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.709293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e690f3fcdbd49028c80eb54b33f480e, user_id=dfc0a1e7b78a4ad887de9753f37d342d, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:37.738709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:37.780289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1388/2768] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:34:37 2021] PUT /identity/v3/projects/9e690f3fcdbd49028c80eb54b33f480e/users/dfc0a1e7b78a4ad887de9753f37d342d/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:37.785817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56824-ba80-43c3-b2cc-6d6b6dfd3416 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.786896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56824-ba80-43c3-b2cc-6d6b6dfd3416 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.787304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad56824-ba80-43c3-b2cc-6d6b6dfd3416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.810638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9ad56824-ba80-43c3-b2cc-6d6b6dfd3416 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:37.811954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9ad56824-ba80-43c3-b2cc-6d6b6dfd3416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.880132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1381/2769] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:37.891412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:37.893171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:37.963063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bdbb1-fb3c-429f-8700-11366393fa46 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:37.966840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:37.967515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:37.967858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:37.968193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:37.979438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:38.007590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3efde2c-c09c-4997-a279-c57d68fee11a service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:38.018648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1389/2770] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:39.436484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:39.436938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:39.437163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:39.478742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] MFA Rules not processed for user `dfc0a1e7b78a4ad887de9753f37d342d`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:39.480017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:39.566847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1382/2771] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:39 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:39.577720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:39.578069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:39.578407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:39.603818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] MFA Rules not processed for user `dfc0a1e7b78a4ad887de9753f37d342d`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:39.605411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:39.618231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1390/2772] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:39 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:39.624837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:39.626375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:39.715674 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecb07d-b962-4cfe-a71a-9a0d07df7bc2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:39.721315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:39.722040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:39.722385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:39.722724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:39.731587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:39.760495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:39.771110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1383/2773] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:39 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:40.249951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:40.260385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311deb9c-feb9-4a79-b501-99b6e8b1c29b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:40.264021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:40.264678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:40.265018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:40.265362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:40.267355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:40.277834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:40.306190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:40.314917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1391/2774] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:40 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:44.509648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:44.513964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:44.524943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acd40f-5508-4e32-a5fd-87135f2faaa9 service nova] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:44.529812 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:44.530729 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:44.531066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:44.531400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] PATH_INFO: `/v3/users/69507673906f416b8ef8befb0e240329` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:44.532646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69507673906f416b8ef8befb0e240329)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:44.561566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:44.832773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69507673906f416b8ef8befb0e240329'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:44.840935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69507673906f416b8ef8befb0e240329'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:44.875901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69507673906f416b8ef8befb0e240329'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:44.876570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69507673906f416b8ef8befb0e240329'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:44.889151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e218af2-1728-4b50-b7b8-fb6e1d80ecd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69507673906f416b8ef8befb0e240329'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:44.896153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1384/2775] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:34:44 2021] DELETE /identity/v3/users/69507673906f416b8ef8befb0e240329 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:45.366744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:45.378385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce767e-f2c4-4498-9b7f-67ac9098af7c service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:45.446813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:45.447639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:45.447977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:45.448308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] PATH_INFO: `/v3/projects/d4336a5d52524343aa75776b3d08929b` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:45.449532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4336a5d52524343aa75776b3d08929b)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:45.479154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:45.614748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4336a5d52524343aa75776b3d08929b', 'request_id': 'req-199bf2a4-9a7b-42ed-a892-e6bf57961279'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:45.620541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4336a5d52524343aa75776b3d08929b', 'request_id': 'req-199bf2a4-9a7b-42ed-a892-e6bf57961279'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:45.670260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4336a5d52524343aa75776b3d08929b', 'request_id': 'req-199bf2a4-9a7b-42ed-a892-e6bf57961279'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:45.687842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] The token cache is being invalidate because project d4336a5d52524343aa75776b3d08929b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:34:45.688168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:45.688831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-199bf2a4-9a7b-42ed-a892-e6bf57961279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:45.690413 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1392/2776] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:34:45 2021] DELETE /identity/v3/projects/d4336a5d52524343aa75776b3d08929b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:45.697117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:45.697415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:45.697752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:45.722241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:45.723573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:45.793629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1385/2777] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:45.802851 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:45.803201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:45.803541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:45.827978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:45.829243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:45.838216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1393/2778] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:34:45.842778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:45.852673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129fd50-4d9b-44ea-86ce-b6233a25edce None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:45.857597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:45.858375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:45.858828 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:45.859189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:45.859957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:34:45.860312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:45.889066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:45.904053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1386/2779] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:34:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:34:45.908968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:45.918383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc866b-334b-4d78-8d5c-1ccea2eb9413 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:45.922990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:45.923650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:45.923987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:45.924320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:45.925037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:45.953942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:46.027073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1394/2780] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:34:45 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:34:46.031678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:46.042052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94709256-86cd-4d75-a8b7-38754b9b42ae admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:46.108453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:46.109151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:46.109497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:46.109873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:46.110604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:46.140264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:46.180029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1387/2781] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:34:46 2021] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:46.184495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:46.195950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf63cf-e73a-4c13-aeec-be43bbfa0f76 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:46.200633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:46.201260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:46.201609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:46.202008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:46.202882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:46.231009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4bd80f-cd81-4f5a-82b1-e141393d2fd8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:46.243053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1395/2782] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:34:46 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:34:46.247651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:46.258732 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d166df-2021-43c8-bfae-f748f3fd3ea8 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:46.263410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:46.264362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:46.264701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:46.265032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] PATH_INFO: `/v3/projects/99706f696d40453a96eab303b3efaaa6/users/7d801de467784fa49959e52a07b18fec/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:46.288071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99706f696d40453a96eab303b3efaaa6, user_id=7d801de467784fa49959e52a07b18fec, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:46.318690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:46.358573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1388/2783] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:34:46 2021] PUT /identity/v3/projects/99706f696d40453a96eab303b3efaaa6/users/7d801de467784fa49959e52a07b18fec/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:46.372120 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:46.372465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:46.372799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:46.416813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] MFA Rules not processed for user `7d801de467784fa49959e52a07b18fec`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:46.418564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:46.508283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1396/2784] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:46 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:34:46.515324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:46.517108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:46.603708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb31e4-2949-450f-9217-39ff922f4ea2 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:46.609390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:46.610082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:46.610427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:46.610758 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:46.619706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:46.649959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63bd2-1e2c-4422-8bab-a775aa4a79f5 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:46.660978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1389/2785] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:46 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:55.116487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:55.188237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4d118-7afc-4bc9-a944-4af177ef0474 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:55.193289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:55.194204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:55.194551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:55.194882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] PATH_INFO: `/v3/users/7d801de467784fa49959e52a07b18fec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:55.196163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d801de467784fa49959e52a07b18fec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:55.225263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:55.369202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d801de467784fa49959e52a07b18fec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:55.377280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d801de467784fa49959e52a07b18fec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:55.412695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d801de467784fa49959e52a07b18fec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:55.413350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d801de467784fa49959e52a07b18fec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:55.425656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d801de467784fa49959e52a07b18fec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:55.431984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1397/2786] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:34:55 2021] DELETE /identity/v3/users/7d801de467784fa49959e52a07b18fec => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:55.436786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:55.437134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:55.437466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:55.462039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:55.463241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:55.530737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1390/2787] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:55.541645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:55.543139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:55.610977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84923ad-9c54-4a10-82ff-9720bc341c70 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:55.615163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:55.615821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:55.616162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:55.616493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:55.626024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:55.654619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6094e-79f1-4f21-8286-61abd4f9ca14 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:55.664416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1398/2788] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:56.081746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.083532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:56.095589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a396b8-d6c1-4c97-8ca7-1c78039a98be None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.101913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.103078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.103417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.103739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] PATH_INFO: `/v3/projects/99706f696d40453a96eab303b3efaaa6` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.104961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99706f696d40453a96eab303b3efaaa6)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.133983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.214706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99706f696d40453a96eab303b3efaaa6', 'request_id': 'req-40f16114-c1fa-44d8-8c72-9d2208872945'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:56.220177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99706f696d40453a96eab303b3efaaa6', 'request_id': 'req-40f16114-c1fa-44d8-8c72-9d2208872945'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:56.247205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99706f696d40453a96eab303b3efaaa6', 'request_id': 'req-40f16114-c1fa-44d8-8c72-9d2208872945'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:56.265132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] The token cache is being invalidate because project 99706f696d40453a96eab303b3efaaa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:34:56.265467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:56.266206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-40f16114-c1fa-44d8-8c72-9d2208872945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:56.267780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1391/2789] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:34:56 2021] DELETE /identity/v3/projects/99706f696d40453a96eab303b3efaaa6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:56.274772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.275266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.275701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.301611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:56.304562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:56.373850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1399/2790] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:56.384320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.384886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.385222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.410157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:56.415698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:56.419050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1392/2791] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:56.423611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.434477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cd28-9f22-4ea9-a12a-1e75edcaecc6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.442805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.443483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.443822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.444153 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.444942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:34:56.445295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.474442 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.489006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1400/2792] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:34:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:34:56.494325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.504721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653d3a9-121b-4dca-bd94-dc67bc7bdab4 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.509707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.510409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.510788 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.511123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.511852 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.540924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.615394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1393/2793] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:34:56 2021] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:56.620040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.631022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c5cc-355f-463f-9182-dd24af880611 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.702933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.703622 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.703999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.704330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.705050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.734695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.803581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1401/2794] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:34:56 2021] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:56.808031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.819005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ab10c-51c3-4a00-9db7-a1b9ebfaff27 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.823928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.824590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.825001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.825330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.826145 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.855922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981c879-40aa-441c-87ea-cc2b20043896 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.870007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1394/2795] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:34:56 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:34:56.873656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:56.884660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5716e-bed0-4b96-ba21-e9d9972c69f1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:56.889205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:56.890139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.890478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.890807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] PATH_INFO: `/v3/projects/0356fec702f14c8c9c20881196c77b53/users/cf0677aa75c44cf6b6e7c42fbb0d3cc2/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:56.913564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0356fec702f14c8c9c20881196c77b53, user_id=cf0677aa75c44cf6b6e7c42fbb0d3cc2, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:56.944235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:56.985510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1402/2796] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:34:56 2021] PUT /identity/v3/projects/0356fec702f14c8c9c20881196c77b53/users/cf0677aa75c44cf6b6e7c42fbb0d3cc2/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:56.996167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:56.996521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:56.996860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:57.036659 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] MFA Rules not processed for user `cf0677aa75c44cf6b6e7c42fbb0d3cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:57.037952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:57.126325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1395/2797] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:56 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:57.136751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:57.138682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:57.226683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ab6e-b70e-4e76-af81-2d8c05f48bf7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:57.232030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:57.232685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:57.233026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:57.233357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:57.242223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:57.270813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482a1e9-1b36-42d8-a7eb-0ff05c1683de service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:57.281085 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1403/2798] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:57 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:57.622166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:57.772836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4979223-8e6d-4357-bf0a-e173eb2afa5b None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:57.777754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:57.778713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:57.779052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:57.779387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] PATH_INFO: `/v3/users/cf0677aa75c44cf6b6e7c42fbb0d3cc2` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:57.780615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0677aa75c44cf6b6e7c42fbb0d3cc2)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:57.809692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:57.912401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0677aa75c44cf6b6e7c42fbb0d3cc2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:57.920677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0677aa75c44cf6b6e7c42fbb0d3cc2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:57.955710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0677aa75c44cf6b6e7c42fbb0d3cc2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:57.956394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0677aa75c44cf6b6e7c42fbb0d3cc2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:57.968859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0677aa75c44cf6b6e7c42fbb0d3cc2'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:57.975496 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1396/2799] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:34:57 2021] DELETE /identity/v3/users/cf0677aa75c44cf6b6e7c42fbb0d3cc2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:57.980045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:57.980391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:57.980725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.004952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:58.006233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:58.073547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1404/2800] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:58.084464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:58.085923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:58.151808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b5075-fefc-43a8-9517-1e3ecfc5371e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:58.155650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:58.156293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:58.156631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:58.156962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.166712 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:58.194721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90b9ed-9734-4811-8e24-97fcdf9c2e97 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:58.204278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1397/2801] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:34:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:34:58.606675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:58.608213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:58.620895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30da94d-2250-4fae-b6a0-98a32c064431 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:58.625471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:58.626384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:58.626721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:58.627053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] PATH_INFO: `/v3/projects/0356fec702f14c8c9c20881196c77b53` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.628248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0356fec702f14c8c9c20881196c77b53)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:58.657637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:58.721924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0356fec702f14c8c9c20881196c77b53', 'request_id': 'req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:58.727722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0356fec702f14c8c9c20881196c77b53', 'request_id': 'req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:58.773458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0356fec702f14c8c9c20881196c77b53', 'request_id': 'req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:58.791458 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] The token cache is being invalidate because project 0356fec702f14c8c9c20881196c77b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:34:58.791791 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:58.792475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff50bec5-64de-4d9b-b7c3-f4cb2bbfd4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:34:58.794095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1405/2802] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:34:58 2021] DELETE /identity/v3/projects/0356fec702f14c8c9c20881196c77b53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:58.800143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:58.800500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:58.801439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.825847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:58.827067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:58.894972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1398/2803] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:58.904044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af603d-9047-4976-9162-03453d70783c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:58.904415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af603d-9047-4976-9162-03453d70783c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:58.904754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af603d-9047-4976-9162-03453d70783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.929370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-82af603d-9047-4976-9162-03453d70783c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:58.930660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-82af603d-9047-4976-9162-03453d70783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:58.939233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1406/2804] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:58.943814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:58.954235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c17e6-28bc-47fd-8cde-6e126a177ee8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:58.958803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:58.959465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:58.959803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:58.960175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:58.960947 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:34:58.961300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:58.990266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.004439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1399/2805] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:34:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:34:59.008992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af603d-9047-4976-9162-03453d70783c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.018646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af603d-9047-4976-9162-03453d70783c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.023441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.024156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.024455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.024789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.025588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.055404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.118489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1407/2806] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:34:59 2021] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:59.123019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.133165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f60fc-6e37-4f36-b736-facc445842d4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.198069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.198739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.199076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.199405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.200128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.228962 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.282215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1400/2807] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:34:59 2021] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:59.286924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.297580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718a368-d187-4ff5-b509-628c9166ed5e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.302242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.302906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.303246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.303602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.304429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.332611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6848e6-e5f3-409a-ab2c-fca55e8a49bb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.343360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1408/2808] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:34:59.348149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.358484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4653-a3d5-416b-abc8-fd31952ef663 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.363066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.364015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.364524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.364867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] PATH_INFO: `/v3/projects/bcbfc6c2344545cea3b44ff578542068/users/62283d1387854dc49722fcb99b342b38/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.389957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbfc6c2344545cea3b44ff578542068, user_id=62283d1387854dc49722fcb99b342b38, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.422370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.469875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1401/2809] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:34:59 2021] PUT /identity/v3/projects/bcbfc6c2344545cea3b44ff578542068/users/62283d1387854dc49722fcb99b342b38/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:34:59.482449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.482805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.483142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.523484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] MFA Rules not processed for user `62283d1387854dc49722fcb99b342b38`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:34:59.524713 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:34:59.600347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1409/2810] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:34:59 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:34:59.605111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.681872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d77-5d41-4e85-a56a-f568db75916a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.686512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.687185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.687526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.687860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.688584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.717614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.768076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1402/2811] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:34:59 2021] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:59.773042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.784214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9eb21-0157-474b-950a-061be5cfcd99 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.850539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.851162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.851505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.851930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.852597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.881931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.915969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1410/2812] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:34:59 2021] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:34:59.920521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.931275 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d151046-c526-4a9f-906d-857b95ecc9d1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.936071 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:34:59.936786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:34:59.937146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:34:59.937510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:34:59.938331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:34:59.967428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:34:59.980254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1403/2813] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:34:59 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:34:59.984744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:34:59.995109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2c2331-73ec-4e19-961f-0d4ec5cb19c0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:34:59.999937 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.000904 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.001244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.001577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] PATH_INFO: `/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.025317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ca51b5d624bfab925cbea51800e58, user_id=6657a95fb0f9410cb7e36ea094254cec, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.055290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.081554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1411/2814] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:34:59 2021] PUT /identity/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:00.085767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.095810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb4b0c-d7a7-4934-b0bb-fda5c3a6a0be admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.160936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.161614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.161984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.162319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.163103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.192083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.202804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1404/2815] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:00.207311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.217697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df393c-6170-45c7-8c6a-b41738d0cdc6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.222358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.223259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.223601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.223940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] PATH_INFO: `/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.225956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ca51b5d624bfab925cbea51800e58, user_id=6657a95fb0f9410cb7e36ea094254cec, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.256038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.266498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1412/2816] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:00 2021] PUT /identity/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:00.270469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.280867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ebbcb-e20e-41da-9364-a1cbde356364 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.346657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.347322 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.347666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.347997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.348779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.376800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1e19-a758-4150-ae01-0583b2d0aa3b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.387888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1405/2817] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:00 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:00.392464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.403253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb800-73d5-4a1f-993e-388153d56ab4 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.407822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.408716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.409056 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.409393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] PATH_INFO: `/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.411978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1ca51b5d624bfab925cbea51800e58, user_id=6657a95fb0f9410cb7e36ea094254cec, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.441636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.494750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1413/2818] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:00 2021] PUT /identity/v3/projects/ef1ca51b5d624bfab925cbea51800e58/users/6657a95fb0f9410cb7e36ea094254cec/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:00.505284 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.505639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.506317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.544310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] MFA Rules not processed for user `6657a95fb0f9410cb7e36ea094254cec`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:00.545546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:00.627231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1406/2819] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:00 2021] POST /identity/v3/auth/tokens => generated 3763 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:00.637621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.639360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:00.706412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cc9ea-e5bb-4821-af41-e325aa06daf8 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.710163 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.710829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.711174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.711510 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.721082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.750116 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.759780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1414/2820] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:00 2021] GET /identity/v3/auth/tokens => generated 3763 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:00.808979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.810557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:00.822689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870ced-657d-4b31-b85c-962652577d9f None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:00.826298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:00.826940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:00.827277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:00.827605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:00.893699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:00.915300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:00.916737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:00.922772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90a6b7-1352-4cd1-8898-997890de5795 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:00.932858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1407/2821] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:00 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:01.004249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8cedf-bee4-4089-9448-2cd2391e07d3 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:01.009323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:01.010128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:01.010587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:01.011014 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:01.013300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:01.025875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:01.054822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:01.065095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1415/2822] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:00 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:04.591931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b852e-39f1-4c61-b15a-96e5eb8d84fa None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:04.592404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b852e-39f1-4c61-b15a-96e5eb8d84fa None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:04.592596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b852e-39f1-4c61-b15a-96e5eb8d84fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:04.617873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-587b852e-39f1-4c61-b15a-96e5eb8d84fa None None] MFA Rules not processed for user `dfc0a1e7b78a4ad887de9753f37d342d`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:04.619091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-587b852e-39f1-4c61-b15a-96e5eb8d84fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:04.690099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1408/2823] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:04 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:05.448759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:05.527652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f018-5a95-4825-a423-65c4884f06a4 service placement] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:05.532805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:05.533689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:05.534091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:05.534430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] PATH_INFO: `/v3/users/62283d1387854dc49722fcb99b342b38` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:05.536511 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=62283d1387854dc49722fcb99b342b38)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:05.565411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:05.656499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62283d1387854dc49722fcb99b342b38'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:05.666235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62283d1387854dc49722fcb99b342b38'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:05.727222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62283d1387854dc49722fcb99b342b38'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:05.727908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62283d1387854dc49722fcb99b342b38'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:05.741294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62283d1387854dc49722fcb99b342b38'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:05.747667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1416/2824] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:05 2021] DELETE /identity/v3/users/62283d1387854dc49722fcb99b342b38 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:05.752535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:05.752960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:05.753304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:05.779509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:05.779726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:05.848793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1409/2825] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:05.859698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:05.861184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:05.929620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc134e-9ec7-4a8d-9efa-9dd5c480b2cc admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:05.933379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:05.935315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:05.935315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:05.935315 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:05.944869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:05.973997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:05.984386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1417/2826] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:05 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:06.620822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:06.622348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:06.636075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c474ce8-f2f0-4965-9d4c-c022f1fe303c None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:06.640761 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:06.641645 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:06.642018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:06.642357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] PATH_INFO: `/v3/projects/bcbfc6c2344545cea3b44ff578542068` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:06.643589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbfc6c2344545cea3b44ff578542068)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:06.673208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:06.788408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbfc6c2344545cea3b44ff578542068', 'request_id': 'req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:06.797349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbfc6c2344545cea3b44ff578542068', 'request_id': 'req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:06.830312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbfc6c2344545cea3b44ff578542068', 'request_id': 'req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:06.849323 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] The token cache is being invalidate because project bcbfc6c2344545cea3b44ff578542068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:06.849601 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:06.850426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:06.852063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1410/2827] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:06 2021] DELETE /identity/v3/projects/bcbfc6c2344545cea3b44ff578542068 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:06.856211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:06.867749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c7b9a-8798-4e30-963f-ef37ab5743f0 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:06.938552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:06.939569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:06.939907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:06.940235 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] PATH_INFO: `/v3/users/6657a95fb0f9410cb7e36ea094254cec` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:06.941469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6657a95fb0f9410cb7e36ea094254cec)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:06.970375 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:07.090383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6657a95fb0f9410cb7e36ea094254cec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.099200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6657a95fb0f9410cb7e36ea094254cec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.138268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6657a95fb0f9410cb7e36ea094254cec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.138877 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6657a95fb0f9410cb7e36ea094254cec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.151627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-990ec3ff-167a-495a-bbcc-059df331ca74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6657a95fb0f9410cb7e36ea094254cec'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.158390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1418/2828] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:06 2021] DELETE /identity/v3/users/6657a95fb0f9410cb7e36ea094254cec => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:35:07.643066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:07.653744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:07.671001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd8e5a-c11d-411c-a8ce-97cac41b97cc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:07.742075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:07.742977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:07.743318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:07.743650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] PATH_INFO: `/v3/projects/ef1ca51b5d624bfab925cbea51800e58` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:07.744901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1ca51b5d624bfab925cbea51800e58)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:07.773797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:07.856178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1ca51b5d624bfab925cbea51800e58', 'request_id': 'req-9a78c449-d898-4784-964b-39f1a6480caa'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.862453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1ca51b5d624bfab925cbea51800e58', 'request_id': 'req-9a78c449-d898-4784-964b-39f1a6480caa'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.898928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1ca51b5d624bfab925cbea51800e58', 'request_id': 'req-9a78c449-d898-4784-964b-39f1a6480caa'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.918250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] The token cache is being invalidate because project ef1ca51b5d624bfab925cbea51800e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:07.918586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.919281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9a78c449-d898-4784-964b-39f1a6480caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:07.924824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1411/2829] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:07 2021] DELETE /identity/v3/projects/ef1ca51b5d624bfab925cbea51800e58 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:07.927076 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:07.927423 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:07.927760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:07.951949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:07.953075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:08.039266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1419/2830] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:08.047878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.048232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.048569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.073919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:08.075159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:08.083330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1412/2831] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:08.088005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.098362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066177c-9a37-4bf3-bd14-045f4cfeb257 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.102995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.103663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.104000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.104334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.105117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:35:08.105470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.134261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.152276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1420/2832] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:35:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:35:08.153726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.163369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ae65e-2eea-4f7f-b481-fec840c82084 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.168719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.169390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.169730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.170186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.170922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.200251 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.265579 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1413/2833] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:08.266960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.278566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8c96-8cb9-4c95-a6a8-50e85dfd3763 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.355200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.355903 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.356231 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.356800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.357269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.387114 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.442847 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1421/2834] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:08.447328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.457733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07f76-c073-418e-b5cd-9f2605a36c68 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.462353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.463048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.463409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.463704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.464488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.492941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb537c-b6f5-43a3-9e12-7d85eeaeb317 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.505272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1414/2835] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:08 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:08.509731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.519955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b256924-a12b-4a9a-a57c-507ce0e8eb78 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.524542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.525445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.525781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.526139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] PATH_INFO: `/v3/projects/86d0dc8d63464f9c95589c6fccd574d6/users/e898ae2cbd5f4b8abccdb0b53f2976b1/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.547128 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d0dc8d63464f9c95589c6fccd574d6, user_id=e898ae2cbd5f4b8abccdb0b53f2976b1, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.577224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.620516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1422/2836] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:08 2021] PUT /identity/v3/projects/86d0dc8d63464f9c95589c6fccd574d6/users/e898ae2cbd5f4b8abccdb0b53f2976b1/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:08.632858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.633211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.633549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.673434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] MFA Rules not processed for user `e898ae2cbd5f4b8abccdb0b53f2976b1`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:08.674707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:08.751254 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1415/2837] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/auth/tokens => generated 3706 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:08.756032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.828910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278e158-7118-4601-8ded-76e04ec56dac admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:08.833724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:08.834429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:08.834774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:08.835112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:08.835838 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:08.865243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:08.952390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1423/2838] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:35:08.957989 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:08.971573 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6a235-503a-4def-b353-96f5ae25a6e2 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.055587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.056839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.057335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.057874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.058781 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.093045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.140922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1416/2839] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:08 2021] POST /identity/v3/users => generated 306 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:09.145860 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.159166 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542043-025a-4473-9e68-73a121e0a8fb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.164701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.165676 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.166152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.166595 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.167501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.196569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.210035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1424/2840] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:09.214665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.226091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738f32b-3abc-4089-a7ea-b99aa3668e7b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.231207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.232117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.232452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.232912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] PATH_INFO: `/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.255551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64664e20bce434da729c199508b7f18, user_id=a16ee10ba5cc4001a0ad6bbb930f0a03, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.286868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.334055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1417/2841] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:09 2021] PUT /identity/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:09.338421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.349481 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc25f8e-d0f7-49f4-a906-b2c124001e91 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.416455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.417186 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.417525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.417991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.418829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.447819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.463999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1425/2842] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:09.465261 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.476123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0fa9-9fe2-428c-b27b-30785428f12b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.481991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.484688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.484688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.484688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] PATH_INFO: `/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.486950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64664e20bce434da729c199508b7f18, user_id=a16ee10ba5cc4001a0ad6bbb930f0a03, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.524026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.535402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1418/2843] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:09 2021] PUT /identity/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:09.539548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.549705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07755e9-8c11-4f7f-aa7c-aeee69afc60a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.615491 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.616173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.616514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.616846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.617626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.646778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd9e14-1a9a-4c36-ad02-99f575ce9200 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.658309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1426/2844] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:09 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:09.662871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.673403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cb3a-ac43-4916-a2bf-c5000ef374d4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.678083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.679012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.679353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.679689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] PATH_INFO: `/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.681686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64664e20bce434da729c199508b7f18, user_id=a16ee10ba5cc4001a0ad6bbb930f0a03, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:09.712095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:09.757380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1419/2845] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:09 2021] PUT /identity/v3/projects/f64664e20bce434da729c199508b7f18/users/a16ee10ba5cc4001a0ad6bbb930f0a03/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:09.768477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.768773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.769637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.808199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] MFA Rules not processed for user `a16ee10ba5cc4001a0ad6bbb930f0a03`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:09.809420 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:09.891304 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1427/2846] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:09 2021] POST /identity/v3/auth/tokens => generated 3773 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:09.901931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:09.903697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:09.972549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437e91-5160-4548-b401-c10bd4e38940 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:09.976878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:09.977541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:09.977922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:09.978257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:09.988098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:10.016704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:10.028648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1420/2847] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:09 2021] GET /identity/v3/auth/tokens => generated 3773 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:10.235049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:10.245134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f503cd-b030-4a4e-8fd0-9f0890262f95 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:10.248709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:10.249361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:10.249703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:10.250070 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:10.319138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:10.348182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae168-422d-4451-a473-6a485f7833fa service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:10.358985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1428/2848] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:10 2021] GET /identity/v3/auth/tokens => generated 3706 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:15.467651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:15.542770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da2d2-ad01-4e58-a353-b3b89b808e38 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:15.547363 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:15.548255 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:15.548604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:15.548942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] PATH_INFO: `/v3/users/e898ae2cbd5f4b8abccdb0b53f2976b1` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:15.550214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e898ae2cbd5f4b8abccdb0b53f2976b1)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:15.579027 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:15.684346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e898ae2cbd5f4b8abccdb0b53f2976b1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:15.693394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e898ae2cbd5f4b8abccdb0b53f2976b1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:15.733183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e898ae2cbd5f4b8abccdb0b53f2976b1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:15.733916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e898ae2cbd5f4b8abccdb0b53f2976b1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:15.746468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e898ae2cbd5f4b8abccdb0b53f2976b1'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:15.752945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1421/2849] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:15 2021] DELETE /identity/v3/users/e898ae2cbd5f4b8abccdb0b53f2976b1 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:15.758220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:15.758576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:15.758917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:15.783106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:15.786895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:15.852370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1429/2850] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:15.863657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:15.865086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:15.931106 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5ef71-ea98-4f6a-8ea8-e44ad6853b31 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:15.934707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:15.935354 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:15.935692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:15.936021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:15.945863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:15.973314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:15.983404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1422/2851] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:16.496177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:16.497662 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:16.510220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e047ef-644d-410e-9eca-47a5dba336c9 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:16.514787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:16.515663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:16.516004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:16.516337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] PATH_INFO: `/v3/projects/86d0dc8d63464f9c95589c6fccd574d6` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:16.517549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d0dc8d63464f9c95589c6fccd574d6)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:16.547294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:16.625098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d0dc8d63464f9c95589c6fccd574d6', 'request_id': 'req-6cdb4393-a221-44cf-b0c7-8e3facc64e65'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.630341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d0dc8d63464f9c95589c6fccd574d6', 'request_id': 'req-6cdb4393-a221-44cf-b0c7-8e3facc64e65'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.674770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d0dc8d63464f9c95589c6fccd574d6', 'request_id': 'req-6cdb4393-a221-44cf-b0c7-8e3facc64e65'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.691902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] The token cache is being invalidate because project 86d0dc8d63464f9c95589c6fccd574d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:16.692229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.692891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.694455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1430/2852] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:16 2021] DELETE /identity/v3/projects/86d0dc8d63464f9c95589c6fccd574d6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:16.698683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:16.709041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b84a-1af4-48d5-b550-8d98da2c33bf service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:16.774048 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:16.774878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:16.775193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:16.775526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] PATH_INFO: `/v3/users/a16ee10ba5cc4001a0ad6bbb930f0a03` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:16.776988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16ee10ba5cc4001a0ad6bbb930f0a03)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:16.805730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:16.912332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16ee10ba5cc4001a0ad6bbb930f0a03'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.920499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16ee10ba5cc4001a0ad6bbb930f0a03'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.957126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16ee10ba5cc4001a0ad6bbb930f0a03'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.958497 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16ee10ba5cc4001a0ad6bbb930f0a03'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.986536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-78ffba0f-4ccc-4715-b6f5-94ed79490ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16ee10ba5cc4001a0ad6bbb930f0a03'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:16.993057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1423/2853] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:16 2021] DELETE /identity/v3/users/a16ee10ba5cc4001a0ad6bbb930f0a03 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:17.424190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:17.426337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:17.439463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4393-a221-44cf-b0c7-8e3facc64e65 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:17.508620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:17.509507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:17.509869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:17.510204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] PATH_INFO: `/v3/projects/f64664e20bce434da729c199508b7f18` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:17.511404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64664e20bce434da729c199508b7f18)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:17.539964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:17.620950 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64664e20bce434da729c199508b7f18', 'request_id': 'req-7c89d9a2-eb4c-4799-964b-fd0881524d6f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:17.626631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64664e20bce434da729c199508b7f18', 'request_id': 'req-7c89d9a2-eb4c-4799-964b-fd0881524d6f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:17.664476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64664e20bce434da729c199508b7f18', 'request_id': 'req-7c89d9a2-eb4c-4799-964b-fd0881524d6f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:17.682751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] The token cache is being invalidate because project f64664e20bce434da729c199508b7f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:17.683095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:17.683793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-7c89d9a2-eb4c-4799-964b-fd0881524d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:17.685599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1431/2854] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:17 2021] DELETE /identity/v3/projects/f64664e20bce434da729c199508b7f18 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:17.691931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:17.693303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:17.693303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:17.716964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:17.718268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:17.806424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1424/2855] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:17.814834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:17.815196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:17.815428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:17.840135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:17.841376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:17.849155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1432/2856] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:17.853629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:17.863668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc732c0-de4a-45f8-b36c-4cad53f284d7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:17.868369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:17.869033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:17.869370 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:17.869702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:17.870523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:35:17.870919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:17.900112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:17.917660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1425/2857] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:35:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:35:17.918995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:17.928948 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a2651-2fce-4164-acbe-3e509fdb55b7 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:17.933633 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:17.934340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:17.934678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:17.935008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:17.935766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:17.964908 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.019930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1433/2858] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:17 2021] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:18.022627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.033307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001408a4-125d-4b10-be6b-904758723fe5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.104823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.105513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.105895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.106230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.106944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.136282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.184744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1426/2859] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:18 2021] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:18.189185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.200262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a223d-ea6a-471c-bba4-88d1a4c6bed5 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.204869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.205536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.205902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.206241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.207017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.234927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76ffdf-667d-4013-9214-46f88c6efed6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.246139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1434/2860] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:18 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:18.250467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.261217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9ad1c-7fb8-4d0c-89ad-42b2fea4003d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.265719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.266639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.266973 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.267299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] PATH_INFO: `/v3/projects/920100475d7c4367901bd7ca0350432c/users/7050bdf94e754510916bf3edd40aa8c0/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.287964 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920100475d7c4367901bd7ca0350432c, user_id=7050bdf94e754510916bf3edd40aa8c0, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.317569 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.372689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1427/2861] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:18 2021] PUT /identity/v3/projects/920100475d7c4367901bd7ca0350432c/users/7050bdf94e754510916bf3edd40aa8c0/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:18.384704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.385054 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.385391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.423429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] MFA Rules not processed for user `7050bdf94e754510916bf3edd40aa8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:18.424651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:18.501842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1435/2862] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:18 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:18.506532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.579362 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f88c9-577a-4d0d-b0e2-5885ea810927 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.583996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.584667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.585010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.585346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.586102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.615450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.674412 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1428/2863] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:18 2021] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:18.676250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.687222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573836e-52c6-4009-b9c4-e9d7ee9c56d1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.752625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.753336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.753711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.754098 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.754797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.783733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.851225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1436/2864] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:18 2021] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:18.852470 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.863045 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11bc0d-b105-4c53-a575-3252c541cfa1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.867631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.868302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.868642 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.868978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.869765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.898078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:18.914173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1429/2865] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:18 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:18.915661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:18.926188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce6e79-6824-4b5f-918e-e36abe5040bb admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:18.930961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:18.931867 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:18.932208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:18.932537 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] PATH_INFO: `/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:18.964426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a07a9ebe6644ac8101c8a8466e23a0, user_id=7313268fd42940729d5e23989f155b54, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:18.997162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.036742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1437/2866] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:18 2021] PUT /identity/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:19.040782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:19.051465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fb8b9-44ac-4f89-ba51-9c98a51acf79 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:19.125434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:19.127378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.127378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.127378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.127731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:19.157995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.169862 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1430/2867] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:19.174345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:19.185449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad4b7-fd0e-4e17-b54c-1d7d9890ffe6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:19.190012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:19.190951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.191290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.191621 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] PATH_INFO: `/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.193565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a07a9ebe6644ac8101c8a8466e23a0, user_id=7313268fd42940729d5e23989f155b54, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:19.223348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95ed26-e299-4a2d-9d90-2aaa91ed9745 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.234461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1438/2868] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:19 2021] PUT /identity/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:19.239294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:19.249289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733eb56-fe9d-47f8-b2b6-12d8e1d7d21f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:19.310611 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9a1e-e653-437e-ba45-1436cd221449 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.310959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9a1e-e653-437e-ba45-1436cd221449 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.311288 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9a1e-e653-437e-ba45-1436cd221449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.320253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:19.321023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.321416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.321752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.322581 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:19.334923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-960f9a1e-e653-437e-ba45-1436cd221449 None None] MFA Rules not processed for user `dfc0a1e7b78a4ad887de9753f37d342d`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:19.336228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-960f9a1e-e653-437e-ba45-1436cd221449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:19.351775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.367409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1431/2869] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:19 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:35:19.370140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:19.379823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e80ca-6117-45af-a04d-125f75dffb61 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:19.384482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:19.385367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.385707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.386075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] PATH_INFO: `/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.388089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a07a9ebe6644ac8101c8a8466e23a0, user_id=7313268fd42940729d5e23989f155b54, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:19.401414 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1439/2870] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:19 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:35:19.417949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.459392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1432/2871] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:19 2021] PUT /identity/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0/users/7313268fd42940729d5e23989f155b54/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:35:19.470201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.470547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.470870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.512589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] MFA Rules not processed for user `7313268fd42940729d5e23989f155b54`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:19.513825 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:19.596130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1440/2872] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:19 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:19.606521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:19.608517 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:19.683230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12103f9-e446-4e64-8ee8-30c156d493c1 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:19.686872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:19.687546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:19.687883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:19.688213 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:19.699130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:19.727294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3ed2c-f395-4fa4-a6aa-bdcb2ee811d6 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:19.738700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1433/2873] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:19 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:21.011328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:21.084475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35d087-9ed5-4fb1-abcd-7dd764e2a688 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:21.089015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:21.089939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:21.090282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:21.090617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] PATH_INFO: `/v3/users/7050bdf94e754510916bf3edd40aa8c0` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:21.091842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7050bdf94e754510916bf3edd40aa8c0)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:21.120468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:21.237849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7050bdf94e754510916bf3edd40aa8c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:21.246519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7050bdf94e754510916bf3edd40aa8c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:21.275208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7050bdf94e754510916bf3edd40aa8c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:21.275861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7050bdf94e754510916bf3edd40aa8c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:21.288457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7050bdf94e754510916bf3edd40aa8c0'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:21.294773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1441/2874] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:21 2021] DELETE /identity/v3/users/7050bdf94e754510916bf3edd40aa8c0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:21.299607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:21.300454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:21.300839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:21.324888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:21.326164 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:21.397417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1434/2875] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:21.408439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:21.410516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:21.487944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4237ea0-be17-4dd6-85ca-016a9a64231a admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:21.491558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:21.492215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:21.492593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:21.492923 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:21.504230 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:21.532826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:21.544103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1442/2876] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:22.030753 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:22.032244 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:22.043944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b7a13-5140-4db5-97a8-461662aec535 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:22.048961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:22.050368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:22.050775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:22.051107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] PATH_INFO: `/v3/projects/920100475d7c4367901bd7ca0350432c` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:22.052326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920100475d7c4367901bd7ca0350432c)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:22.082426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:22.164142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920100475d7c4367901bd7ca0350432c', 'request_id': 'req-84889302-d374-4f16-a12c-e3789d9ea9c0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.169834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920100475d7c4367901bd7ca0350432c', 'request_id': 'req-84889302-d374-4f16-a12c-e3789d9ea9c0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.230768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920100475d7c4367901bd7ca0350432c', 'request_id': 'req-84889302-d374-4f16-a12c-e3789d9ea9c0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.249199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] The token cache is being invalidate because project 920100475d7c4367901bd7ca0350432c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:22.249535 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.250377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.251953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1435/2877] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:22 2021] DELETE /identity/v3/projects/920100475d7c4367901bd7ca0350432c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:22.256316 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:22.266342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f90b7f-69a2-4a72-888f-6c24e4fd3ca7 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:22.335082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:22.335974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:22.336312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:22.336640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] PATH_INFO: `/v3/users/7313268fd42940729d5e23989f155b54` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:22.337992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7313268fd42940729d5e23989f155b54)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:22.367425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:22.525141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7313268fd42940729d5e23989f155b54'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.533891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7313268fd42940729d5e23989f155b54'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.567005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7313268fd42940729d5e23989f155b54'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.567657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7313268fd42940729d5e23989f155b54'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.580334 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-5c9c9487-4ce3-4a2e-bfd6-1527b2403912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7313268fd42940729d5e23989f155b54'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:22.587268 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1443/2878] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:22 2021] DELETE /identity/v3/users/7313268fd42940729d5e23989f155b54 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:23.145544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.147152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:23.160734 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84889302-d374-4f16-a12c-e3789d9ea9c0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.229568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.230501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.230848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.231185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] PATH_INFO: `/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.232577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a07a9ebe6644ac8101c8a8466e23a0)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:23.263188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:23.358225 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a07a9ebe6644ac8101c8a8466e23a0', 'request_id': 'req-1c7753fc-a028-4006-80bd-69dfc57f3169'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:23.363671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a07a9ebe6644ac8101c8a8466e23a0', 'request_id': 'req-1c7753fc-a028-4006-80bd-69dfc57f3169'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:23.401061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a07a9ebe6644ac8101c8a8466e23a0', 'request_id': 'req-1c7753fc-a028-4006-80bd-69dfc57f3169'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:23.420453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] The token cache is being invalidate because project c1a07a9ebe6644ac8101c8a8466e23a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:23.420785 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:23.421475 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1c7753fc-a028-4006-80bd-69dfc57f3169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:23.423320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1436/2879] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:23 2021] DELETE /identity/v3/projects/c1a07a9ebe6644ac8101c8a8466e23a0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:23.429390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.429855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.430281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.454764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:23.456577 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:23.528343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1444/2880] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:23.538487 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.538872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.539212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.563780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:23.565010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:23.573033 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1437/2881] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:23.577562 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.587882 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39207ce-706c-4be2-9992-5392eb871e0a None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.592417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.593080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.593416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.593745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.594553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:35:23.594940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:23.623390 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:23.637625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1445/2882] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:35:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:35:23.642282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.651922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33facec4-2a75-4c74-af47-f62140a4ebc7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.656588 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.657242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.657578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.657972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.658693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:23.688130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:23.746089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1438/2883] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:23 2021] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:23.750386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.760631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1decb34-b3ff-4f81-a5a2-913548076e76 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.827036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.827845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.828189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.828527 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.829271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:23.858603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:23.914693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1446/2884] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:23 2021] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:23.915997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.927049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0a7ac-aeab-49e5-b6ee-8d5bb52d23ea admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.931682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.932357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.932701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.933039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:23.933875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:23.962574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b51ee7-3e60-4bd2-bc71-558ba35c7f15 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:23.978766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1439/2885] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:23 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:23.980298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:23.993209 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62540a8d-5179-43ea-bd9c-244a31a40978 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:23.998289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:23.999196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:23.999571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:23.999897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] PATH_INFO: `/v3/projects/18a808b09c784faca923872082766764/users/c6c60a7687454e27b543851359002150/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.022499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a808b09c784faca923872082766764, user_id=c6c60a7687454e27b543851359002150, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:24.055749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:24.116695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1447/2886] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:23 2021] PUT /identity/v3/projects/18a808b09c784faca923872082766764/users/c6c60a7687454e27b543851359002150/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:24.127618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:24.128012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:24.128356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.169703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] MFA Rules not processed for user `c6c60a7687454e27b543851359002150`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:24.170969 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:24.253260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1440/2887] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:24 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:24.263934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:24.265666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:24.342686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a62c05-e124-450e-9645-73a7d4318b59 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:24.346353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:24.347051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:24.347387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:24.347715 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.356884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:24.386125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6880d-cc1c-4dc8-a629-f8006528ec67 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:24.396718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1448/2888] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:24 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:24.418376 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:24.503477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928fbf8-3719-47ad-b977-3e08a5d8fad8 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:24.508032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:24.508988 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:24.509332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:24.509660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] PATH_INFO: `/v3/users/c6c60a7687454e27b543851359002150` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.511021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6c60a7687454e27b543851359002150)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:24.539981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:24.643991 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6c60a7687454e27b543851359002150'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:24.652628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6c60a7687454e27b543851359002150'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:24.686220 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6c60a7687454e27b543851359002150'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:24.686886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6c60a7687454e27b543851359002150'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:24.699751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6c60a7687454e27b543851359002150'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:24.706185 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1441/2889] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:24 2021] DELETE /identity/v3/users/c6c60a7687454e27b543851359002150 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:24.710963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:24.711318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:24.711653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.735596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:24.736840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:24.806482 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1449/2890] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:24.817508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:24.819030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:24.886215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0848f74-28d7-49bb-9d22-c3c8adec8a6a admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:24.889890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:24.890552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:24.890890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:24.891223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:24.901597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:24.929756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde501-99d4-4f8a-9057-c9f4c3a995a7 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:24.939777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1442/2891] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:25.548702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:25.551349 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:25.568683 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229d5ba-128f-419d-b965-8d3475379b5f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:25.574104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:25.574665 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:25.575149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:25.575474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] PATH_INFO: `/v3/projects/18a808b09c784faca923872082766764` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:25.576926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a808b09c784faca923872082766764)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:25.606156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:25.708928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a808b09c784faca923872082766764', 'request_id': 'req-a3833072-21df-44f0-a006-60d32bc448e6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:25.714534 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a808b09c784faca923872082766764', 'request_id': 'req-a3833072-21df-44f0-a006-60d32bc448e6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:25.749539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a808b09c784faca923872082766764', 'request_id': 'req-a3833072-21df-44f0-a006-60d32bc448e6'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:25.778754 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] The token cache is being invalidate because project 18a808b09c784faca923872082766764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:25.779454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:25.780336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a3833072-21df-44f0-a006-60d32bc448e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:25.782094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1450/2892] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:25 2021] DELETE /identity/v3/projects/18a808b09c784faca923872082766764 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:25.789029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:25.789378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:25.793051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:25.827505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:25.828995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:25.906564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1443/2893] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:25.915371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:25.915705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:25.916234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:25.941978 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:25.943224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:25.950848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1451/2894] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:25.955974 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:25.982184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125ee54-e28c-49fa-8d77-ae06697e4013 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:25.990385 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:25.991303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:25.991944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:25.992443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:25.993525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:35:25.994134 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.026913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.044310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1444/2895] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:35:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:35:26.049229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:26.061110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2626768-2e2e-488e-8fee-c75e03e8e4de None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:26.066762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:26.067434 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.067782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.068094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.069015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.099234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.163849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1452/2896] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:26 2021] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:26.168343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:26.178637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab0a8-6147-4d8b-a427-9f0f6e7c2f1d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:26.245554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:26.246232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.246520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.246858 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.247625 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.277506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.327036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1445/2897] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:26 2021] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:26.331640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:26.342332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd58c3-673d-41be-9cdc-e181c05530f6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:26.346961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:26.347628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.347970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.348308 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.349091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.377553 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df154a18-cf47-458c-9dbd-696143724fc6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.388946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1453/2898] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:26 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:26.393183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:26.403509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d7235-175e-4aa8-907e-df4c495d2dc0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:26.408052 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:26.408941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.409277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.409617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] PATH_INFO: `/v3/projects/972d7526a3324c71bfd681e0f567a60f/users/810dc5aa66b949ffb63a201d182ecf36/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.432089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972d7526a3324c71bfd681e0f567a60f, user_id=810dc5aa66b949ffb63a201d182ecf36, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.461856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.504627 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1446/2899] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:26 2021] PUT /identity/v3/projects/972d7526a3324c71bfd681e0f567a60f/users/810dc5aa66b949ffb63a201d182ecf36/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:26.515814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.516175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.516504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.554810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] MFA Rules not processed for user `810dc5aa66b949ffb63a201d182ecf36`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:26.556028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:26.631456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1454/2900] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:26 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:26.641471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:26.643228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:26.710123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6129b1-5b90-4fa4-b59a-3b1783d91a40 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:26.713733 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:26.714406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:26.714742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:26.715073 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:26.724188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:26.752160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:26.761287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1447/2901] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:26 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:30.000885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:30.002567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:30.071524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862531c-16f7-41d4-805f-1109c870d869 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:30.075302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:30.075967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:30.076307 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:30.076640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:30.078614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:30.089146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:30.117623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654b923-89c7-4164-b224-ecfad17b438b service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:30.126516 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1455/2902] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:29 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:36.915350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:36.989024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb787bc9-0956-4fa8-94e3-9d55c207fdc5 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:36.993774 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:36.994690 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:36.995031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:36.995367 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] PATH_INFO: `/v3/users/810dc5aa66b949ffb63a201d182ecf36` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:36.996584 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=810dc5aa66b949ffb63a201d182ecf36)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:37.026468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:37.129384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810dc5aa66b949ffb63a201d182ecf36'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:37.137911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810dc5aa66b949ffb63a201d182ecf36'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:37.160949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810dc5aa66b949ffb63a201d182ecf36'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:37.161607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810dc5aa66b949ffb63a201d182ecf36'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:37.174338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810dc5aa66b949ffb63a201d182ecf36'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:37.180759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1448/2903] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:35:36 2021] DELETE /identity/v3/users/810dc5aa66b949ffb63a201d182ecf36 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:37.185570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:37.186039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:37.186380 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:37.210868 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:37.212099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:37.282902 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1456/2904] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:37.293938 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:37.295426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:37.366465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16fa5e-3479-4d71-b696-93fbc47bff7e admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:37.370238 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:37.370901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:37.371300 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:37.371552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:37.382995 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:37.412418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6657a19-a3ae-4e01-88c0-2bed637cb305 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:37.423921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1449/2905] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:37 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:37.899587 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:37.901055 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:37.915777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49af27b-53b4-47a0-801b-2985b2a52232 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:37.920441 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:37.921289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:37.921624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:37.922021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] PATH_INFO: `/v3/projects/972d7526a3324c71bfd681e0f567a60f` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:37.923246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=972d7526a3324c71bfd681e0f567a60f)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:37.952644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.037038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972d7526a3324c71bfd681e0f567a60f', 'request_id': 'req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:38.042636 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972d7526a3324c71bfd681e0f567a60f', 'request_id': 'req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:38.079970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972d7526a3324c71bfd681e0f567a60f', 'request_id': 'req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:38.098398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] The token cache is being invalidate because project 972d7526a3324c71bfd681e0f567a60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:35:38.098728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:38.099399 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-b9fe0398-d7e8-4c70-b21a-f09d8ef1ee74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:35:38.100953 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1457/2906] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:35:37 2021] DELETE /identity/v3/projects/972d7526a3324c71bfd681e0f567a60f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:38.106979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.107368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.107792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.131914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:38.133100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:38.201749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1450/2907] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:38.210717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.211095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.211433 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.235267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:38.236472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:38.244652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1458/2908] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:38.249985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:38.259814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960aeb-bfb6-4bde-a8c0-e26fb1861f14 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:38.264276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:38.264945 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.265283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.265618 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.266427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:35:38.266782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:38.296038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.309449 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1451/2909] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:35:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:35:38.313844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:38.323068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f32e-95cd-4a03-a19e-e3f34c45bb24 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:38.327626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:38.328259 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.328598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.328931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.329651 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:38.358951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.413270 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1459/2910] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:38.417545 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:38.427721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ea51-b7da-48b8-b9e7-8685389b4b54 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:38.497383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:38.498194 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.498563 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.498897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.499616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:38.528602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.572941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1452/2911] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:35:38.577404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:38.588080 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac09db7-c3ab-4ff6-8957-10a30e15aa51 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:38.592653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:38.593361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.593704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.594068 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.594843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:38.623459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f30ae3-2ebf-4db0-bdaa-f9baae7c9f68 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.634990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1460/2912] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:35:38 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:35:38.639294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:38.649568 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7812-87e7-4f61-90fa-89fd06b7492c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:38.654536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:38.655430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.655772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.656135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] PATH_INFO: `/v3/projects/0511a85e89cc4cc8bc09677ea152b166/users/b627e29d8d7e4cc3b1059f30388a2efd/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.678447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0511a85e89cc4cc8bc09677ea152b166, user_id=b627e29d8d7e4cc3b1059f30388a2efd, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:38.707943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ae204-3e05-41a4-a2fa-346a00dc9dbe admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:38.749745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1453/2913] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:35:38 2021] PUT /identity/v3/projects/0511a85e89cc4cc8bc09677ea152b166/users/b627e29d8d7e4cc3b1059f30388a2efd/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:35:38.760499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475560f-0198-40d8-ab4a-db9e551bf762 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.760889 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475560f-0198-40d8-ab4a-db9e551bf762 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.761229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475560f-0198-40d8-ab4a-db9e551bf762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.799234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-d475560f-0198-40d8-ab4a-db9e551bf762 None None] MFA Rules not processed for user `b627e29d8d7e4cc3b1059f30388a2efd`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:38.801122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-d475560f-0198-40d8-ab4a-db9e551bf762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:38.875656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1461/2914] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:38.887846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fced22-2546-4fe6-9b5c-ed62cd961935 None None] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.888200 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fced22-2546-4fe6-9b5c-ed62cd961935 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.888540 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fced22-2546-4fe6-9b5c-ed62cd961935 None None] PATH_INFO: `/` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.890401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1454/2915] 10.222.0.18 () {54 vars in 945 bytes} [Sat Aug 21 12:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 12:35:38.896180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b2e9-675d-4e78-8ec0-4aab4cffb4ee None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:38.896567 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b2e9-675d-4e78-8ec0-4aab4cffb4ee None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:38.896898 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b2e9-675d-4e78-8ec0-4aab4cffb4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:38.969061 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e6e6b2e9-675d-4e78-8ec0-4aab4cffb4ee None None] MFA Rules not processed for user `ae4fdee19f3c4821b3831f77f2273d52`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:38.970336 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e6e6b2e9-675d-4e78-8ec0-4aab4cffb4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:39.046454 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1462/2916] 10.222.0.18 () {58 vars in 1043 bytes} [Sat Aug 21 12:35:38 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:39.055010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fced22-2546-4fe6-9b5c-ed62cd961935 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:39.067087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fced22-2546-4fe6-9b5c-ed62cd961935 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:39.070933 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:39.071582 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:39.071924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:39.072280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:39.082864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:39.111122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:39.121260 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1455/2917] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:39 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:35:47.126536 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08381c-ee18-428e-aa9e-7e048fbefc9a None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:47.127066 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08381c-ee18-428e-aa9e-7e048fbefc9a None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:47.127172 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08381c-ee18-428e-aa9e-7e048fbefc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:47.149714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ee08381c-ee18-428e-aa9e-7e048fbefc9a None None] MFA Rules not processed for user `dfc0a1e7b78a4ad887de9753f37d342d`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:35:47.151314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ee08381c-ee18-428e-aa9e-7e048fbefc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:47.217570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1463/2918] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:35:47 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:35:52.560345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:35:52.561865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:52.631224 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7977b6-4be1-4c4b-8969-cb8dc71fb7fe service glance] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:35:52.640118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:35:52.640118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:35:52.640118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:35:52.640118 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:35:52.640566 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:35:52.712461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:35:52.740926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:35:52.750718 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1456/2919] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:35:52 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:36:01.583108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bca31-045d-47a7-b57f-50983b34e3ed None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:01.583608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bca31-045d-47a7-b57f-50983b34e3ed None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:01.583744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bca31-045d-47a7-b57f-50983b34e3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:01.606524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2c9bca31-045d-47a7-b57f-50983b34e3ed None None] MFA Rules not processed for user `1140a3e552794d0892bc7fcb5535c9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:01.607725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2c9bca31-045d-47a7-b57f-50983b34e3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:01.614787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1464/2920] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:01 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:17.183201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:17.257017 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee6a-eaa7-4dd4-81ec-556b911af973 service cinder] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:17.261526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:17.262444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:17.262786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:17.263113 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] PATH_INFO: `/v3/users/b627e29d8d7e4cc3b1059f30388a2efd` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:17.264411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b627e29d8d7e4cc3b1059f30388a2efd)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:17.294049 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:17.391011 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b627e29d8d7e4cc3b1059f30388a2efd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:17.399706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b627e29d8d7e4cc3b1059f30388a2efd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:17.429072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b627e29d8d7e4cc3b1059f30388a2efd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:17.429722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b627e29d8d7e4cc3b1059f30388a2efd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:17.441999 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b627e29d8d7e4cc3b1059f30388a2efd'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:17.448298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1457/2921] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:36:17 2021] DELETE /identity/v3/users/b627e29d8d7e4cc3b1059f30388a2efd => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:17.453253 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:17.453604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:17.453975 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:17.478074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:17.479271 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:17.546671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1465/2922] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:36:17.557506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:17.559000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:17.626928 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365d55a-5af4-4f58-a240-38240b948c10 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:17.631187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:17.631845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:17.632357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:17.632613 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:17.642223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:17.670871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:17.680544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1458/2923] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:36:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:36:18.153832 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:18.155312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:18.167837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ed0dc-9db6-46ae-a00d-f510a6ecfe6b None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:18.172373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:18.173394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:18.173730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:18.174095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] PATH_INFO: `/v3/projects/0511a85e89cc4cc8bc09677ea152b166` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:18.175303 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0511a85e89cc4cc8bc09677ea152b166)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:18.204745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:18.282468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0511a85e89cc4cc8bc09677ea152b166', 'request_id': 'req-792bda59-1c2b-405d-961b-afcdeaf6b064'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:18.288450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0511a85e89cc4cc8bc09677ea152b166', 'request_id': 'req-792bda59-1c2b-405d-961b-afcdeaf6b064'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:18.314653 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0511a85e89cc4cc8bc09677ea152b166', 'request_id': 'req-792bda59-1c2b-405d-961b-afcdeaf6b064'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:18.332870 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] The token cache is being invalidate because project 0511a85e89cc4cc8bc09677ea152b166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:36:18.333210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:18.333914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:18.335445 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1466/2924] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:36:18 2021] DELETE /identity/v3/projects/0511a85e89cc4cc8bc09677ea152b166 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:29.466105 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:29.467893 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:29.561108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f63f-df51-436e-b0c4-857f4bbb84e3 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:29.634869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:29.635462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:29.635846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:29.636215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:29.638228 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:29.650968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:29.678977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:29.690077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1459/2925] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:36:29 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:36:42.975053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:42.976764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:43.053848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bda59-1c2b-405d-961b-afcdeaf6b064 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:43.058388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:43.059272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:43.059612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:43.059972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] PATH_INFO: `/v3/users/dfc0a1e7b78a4ad887de9753f37d342d` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:43.061180 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfc0a1e7b78a4ad887de9753f37d342d)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:43.089678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:43.264826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfc0a1e7b78a4ad887de9753f37d342d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.272826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfc0a1e7b78a4ad887de9753f37d342d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.308711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfc0a1e7b78a4ad887de9753f37d342d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.309372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfc0a1e7b78a4ad887de9753f37d342d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.321773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-73a6ba23-1fce-4513-bd8a-b4ff8c7a2979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfc0a1e7b78a4ad887de9753f37d342d'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.328020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1467/2926] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:36:42 2021] DELETE /identity/v3/users/dfc0a1e7b78a4ad887de9753f37d342d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:43.655924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:43.667461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2ed6e-54e5-49f0-86be-09bc614ecf96 service nova] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:43.734277 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:43.735152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:43.735490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:43.735819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] PATH_INFO: `/v3/projects/9e690f3fcdbd49028c80eb54b33f480e` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:43.737023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e690f3fcdbd49028c80eb54b33f480e)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:43.765998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:43.856886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e690f3fcdbd49028c80eb54b33f480e', 'request_id': 'req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.862042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e690f3fcdbd49028c80eb54b33f480e', 'request_id': 'req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.897208 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e690f3fcdbd49028c80eb54b33f480e', 'request_id': 'req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.914709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] The token cache is being invalidate because project 9e690f3fcdbd49028c80eb54b33f480e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:36:43.915035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.915705 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-54cc0f67-9b7f-4945-9f9c-7c9cd122d416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:43.917355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1460/2927] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:36:43 2021] DELETE /identity/v3/projects/9e690f3fcdbd49028c80eb54b33f480e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:43.923661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667059b2-a040-41b2-9268-027921518e13 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:43.924005 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667059b2-a040-41b2-9268-027921518e13 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:43.924343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667059b2-a040-41b2-9268-027921518e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:43.948143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-667059b2-a040-41b2-9268-027921518e13 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:43.949351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-667059b2-a040-41b2-9268-027921518e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:44.018215 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1468/2928] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:44.026804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.027154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.027528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.051997 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:44.053176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:44.060605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1461/2929] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:44.064919 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667059b2-a040-41b2-9268-027921518e13 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.074805 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667059b2-a040-41b2-9268-027921518e13 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.079298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.079958 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.080297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.080626 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.081425 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:36:44.081775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.110201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.124108 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1469/2930] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:36:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:36:44.128655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.138036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc424-9f30-4805-b779-431ec3d929ee None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.142634 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.143368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.143710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.144043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.144768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.173839 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.230444 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1462/2931] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:36:44 2021] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:44.234846 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.245460 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e278-c09a-4724-9b99-5c645432ee6f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.310353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.311028 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.311372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.311706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.312428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.341514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.389101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1470/2932] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:36:44 2021] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:44.393480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.404478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91a6f3-9a3d-4bcc-9405-0bda599ecd4f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.409018 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.409691 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.410069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.410409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.411193 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.439417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d96ad-c8a2-45b3-9de0-5d8f59c81c3b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.450879 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1463/2933] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:36:44 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:36:44.455109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.465246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32214740-97cd-45b8-a949-6aed86c41281 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.469644 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.470565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.470895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.471219 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] PATH_INFO: `/v3/projects/df97a5910fb341d6ac950cd52afa3034/users/2eabd23df39642b09626358e07a7c230/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.491985 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=df97a5910fb341d6ac950cd52afa3034, user_id=2eabd23df39642b09626358e07a7c230, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.521760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.560087 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1471/2934] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:36:44 2021] PUT /identity/v3/projects/df97a5910fb341d6ac950cd52afa3034/users/2eabd23df39642b09626358e07a7c230/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:44.571499 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.571843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.572184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.610389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] MFA Rules not processed for user `2eabd23df39642b09626358e07a7c230`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:44.611606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:44.688467 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1464/2935] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:44 2021] POST /identity/v3/auth/tokens => generated 3672 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:44.699272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:44.701019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:44.768873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c3cd-64db-4415-b2a2-db67c3ac8fda admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:44.772501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:44.773152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:44.773493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:44.773856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:44.783192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:44.812093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff8c86-a49d-4d38-9c13-cb6bdfac9c60 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:44.821340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1472/2936] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:36:44 2021] GET /identity/v3/auth/tokens => generated 3672 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:36:55.219093 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:55.291440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5d334-03fe-4ac9-858f-57bca133d62a None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:55.295931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:55.296816 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:55.297159 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:55.297498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] PATH_INFO: `/v3/users/2eabd23df39642b09626358e07a7c230` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:55.298749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eabd23df39642b09626358e07a7c230)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:55.327286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:55.459808 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eabd23df39642b09626358e07a7c230'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:55.468051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eabd23df39642b09626358e07a7c230'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:55.495677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eabd23df39642b09626358e07a7c230'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:55.496330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eabd23df39642b09626358e07a7c230'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:55.509428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eabd23df39642b09626358e07a7c230'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:55.515682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1465/2937] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:36:55 2021] DELETE /identity/v3/users/2eabd23df39642b09626358e07a7c230 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:55.520430 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:55.520783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:55.521121 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:55.544823 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:55.546059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:55.615720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1473/2938] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:55.626783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:55.628241 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:55.695750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6b0a9-334f-4197-86bd-b98862476f5f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:55.699459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:55.700110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:55.700451 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:55.700780 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:55.710698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:55.739205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871021b8-067e-4954-9029-a8b8d34b6a4d service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:55.748798 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1466/2939] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:36:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:36:56.214719 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.216199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:56.228448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b848b2-acc1-4233-9c62-4961ee092ba1 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.233559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.234477 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.234817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.235149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] PATH_INFO: `/v3/projects/df97a5910fb341d6ac950cd52afa3034` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.236368 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df97a5910fb341d6ac950cd52afa3034)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:56.264762 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:56.370405 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df97a5910fb341d6ac950cd52afa3034', 'request_id': 'req-4386463c-6756-4fab-a410-412c8ec7255c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:56.375594 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df97a5910fb341d6ac950cd52afa3034', 'request_id': 'req-4386463c-6756-4fab-a410-412c8ec7255c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:56.421456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df97a5910fb341d6ac950cd52afa3034', 'request_id': 'req-4386463c-6756-4fab-a410-412c8ec7255c'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:56.438580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] The token cache is being invalidate because project df97a5910fb341d6ac950cd52afa3034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:36:56.438907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:56.439574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-4386463c-6756-4fab-a410-412c8ec7255c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:56.441109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1474/2940] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:36:56 2021] DELETE /identity/v3/projects/df97a5910fb341d6ac950cd52afa3034 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:56.447142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.447490 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.447826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.473110 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:56.474366 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:56.542135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1467/2941] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:56.550580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.550921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.551249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.574703 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:56.575917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:56.583960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1475/2942] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:56.588214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.597944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68489c7f-60dd-4343-97ce-8cf56d5316b7 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.602401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.603069 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.603395 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.603727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.604504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:36:56.604854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:56.633287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:56.647059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1468/2943] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:36:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:36:56.651664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.660894 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656e873-5a42-410b-86e7-2afc1d455cc4 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.665421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.666104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.666438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.666768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.667484 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:56.696141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:56.749723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1476/2944] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:36:56 2021] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:36:56.754680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.764817 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f3f46-72ff-4fff-b4f6-bea1ef31494d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.830329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.831597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.831961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.832297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.833019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:56.861411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:56.903176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1469/2945] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:36:56 2021] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:56.907521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.917924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ce7ea-a7b3-496b-83e9-986039371844 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.922418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.923083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.923419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.923748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:56.924525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:56.952929 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5771e0a-edbd-408c-8f95-e0bf51a82fac admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:56.964831 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1477/2946] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:36:56 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:36:56.969097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:56.979409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38613-513a-4b9b-a087-7dcac3a3104d admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:56.984016 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:56.984911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:56.985273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:56.985583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] PATH_INFO: `/v3/projects/4d1b64f6123940a0a1d2260285abcf33/users/935b39b16c784942866e3f0eb9774921/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.009400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1b64f6123940a0a1d2260285abcf33, user_id=935b39b16c784942866e3f0eb9774921, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.038464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.079913 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1470/2947] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:36:56 2021] PUT /identity/v3/projects/4d1b64f6123940a0a1d2260285abcf33/users/935b39b16c784942866e3f0eb9774921/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:57.090688 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.091036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.091369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.130361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] MFA Rules not processed for user `935b39b16c784942866e3f0eb9774921`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:57.131580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:57.206196 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1478/2948] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:57 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:57.210888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.282787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eaad8-48f0-43ca-8d36-439eff9129a6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.287447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.288109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.288446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.288775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.289506 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.318479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.372283 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1471/2949] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:36:57 2021] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:57.376575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.387493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974de13-8460-4efb-a664-1dafd64c219f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.452548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.453157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.453494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.453841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.454564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.483619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.538156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1479/2950] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:36:57 2021] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:57.542359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.553216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f786f8d-c706-46b6-8c5f-1a100bd7f0b4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.557724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.558416 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.558756 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.559086 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.559871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.587714 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.599810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1472/2951] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:36:57.604192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.614998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462238a8-9066-4317-ad86-4ba834cf2b36 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.619557 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.620453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.620792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.621125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] PATH_INFO: `/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.641934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5486a76eb4504bc9883cae1d965f0dd0, user_id=3b6937423dc34f48ad21d225baa09155, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.671745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.713571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1480/2952] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:36:57 2021] PUT /identity/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:57.717767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.728631 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114928-4581-4e3f-8c1a-4f34ea28945f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.794124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.794792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.795139 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.795474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.796256 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.824217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.835325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1473/2953] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:36:57.839679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.850575 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0bb53e-4110-4928-a612-ec2f3c5061d1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.855140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.856042 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.856384 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.856717 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] PATH_INFO: `/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.858749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5486a76eb4504bc9883cae1d965f0dd0, user_id=3b6937423dc34f48ad21d225baa09155, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:57.887806 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:57.898769 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1481/2954] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:36:57 2021] PUT /identity/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:57.903037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:57.913696 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629f1be-e0cc-465e-8bd9-528e92b86acd admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:57.979687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:57.980320 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:57.980699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:57.981040 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:57.981907 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:58.010377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ffbf1-e471-48e2-84c7-fdc48b1e3988 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:58.022358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1474/2955] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:36:57 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:36:58.027067 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:58.037993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b12c-e2b2-4208-bb07-076869ba7db6 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:58.042623 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:58.043533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:58.043874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:58.044211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] PATH_INFO: `/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:58.046214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5486a76eb4504bc9883cae1d965f0dd0, user_id=3b6937423dc34f48ad21d225baa09155, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:58.075944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:58.122576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1482/2956] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:36:58 2021] PUT /identity/v3/projects/5486a76eb4504bc9883cae1d965f0dd0/users/3b6937423dc34f48ad21d225baa09155/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:58.134695 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:58.135044 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:58.135415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:58.173726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] MFA Rules not processed for user `3b6937423dc34f48ad21d225baa09155`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:36:58.174979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:58.252310 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1475/2957] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:36:58 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:36:58.264590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:58.266351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:58.333206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f30b-72f7-4730-b6b2-983185c0a183 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:58.336897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:58.337548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:58.337918 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:58.338257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:58.348146 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:58.375972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:58.386111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1483/2958] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:36:58 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 12:36:58.967100 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:58.976648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a5ec-cb50-49aa-8d1c-b717633e8be0 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:58.981237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6937423dc34f48ad21d225baa09155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5486a76eb4504bc9883cae1d965f0dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:58.981976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:58.982331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:58.982672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:58.983464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:36:58.983821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:59.012387 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:59.028789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1476/2959] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:36:59.033361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:59.042750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d888-a8e8-49b4-9abb-5df0392fb405 service cinder] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:59.047379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6937423dc34f48ad21d225baa09155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5486a76eb4504bc9883cae1d965f0dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:59.048039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:59.048389 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:59.048731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:59.049456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:59.078191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:59.138297 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1484/2960] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:36:59 2021] POST /identity/v3/projects => generated 354 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:36:59.142655 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:59.153479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a8999-ba8b-4db1-a9ae-7d8beb7e8f70 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:59.218869 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6937423dc34f48ad21d225baa09155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5486a76eb4504bc9883cae1d965f0dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:59.219476 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:59.219826 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:59.220170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:59.220956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:36:59.221312 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:59.249759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:59.263443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1477/2961] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:36:59.303006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:59.313778 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec068d59-6a5c-4fc8-883c-6beb2544e824 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:59.319008 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b6937423dc34f48ad21d225baa09155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5486a76eb4504bc9883cae1d965f0dd0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:59.319890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:59.320236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:59.320571 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] PATH_INFO: `/v3/projects/23a7641c9f0e48b6aa0d3908a7a8a1d0` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:59.321813 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorizing `identity:delete_project(project_id=23a7641c9f0e48b6aa0d3908a7a8a1d0)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:36:59.350099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:36:59.423127 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a7641c9f0e48b6aa0d3908a7a8a1d0', 'request_id': 'req-2f977e68-7507-4a87-96ef-9ab1d2355524'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:59.429035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a7641c9f0e48b6aa0d3908a7a8a1d0', 'request_id': 'req-2f977e68-7507-4a87-96ef-9ab1d2355524'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:59.474137 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a7641c9f0e48b6aa0d3908a7a8a1d0', 'request_id': 'req-2f977e68-7507-4a87-96ef-9ab1d2355524'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:59.491792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] The token cache is being invalidate because project 23a7641c9f0e48b6aa0d3908a7a8a1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:36:59.492125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:59.492797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2f977e68-7507-4a87-96ef-9ab1d2355524 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:36:59.495279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1485/2962] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:36:59 2021] DELETE /identity/v3/projects/23a7641c9f0e48b6aa0d3908a7a8a1d0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:36:59.826359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:36:59.828102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:36:59.906361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f72d5-40a0-491f-a676-044ebdaae9b5 tempest-VolumeQuotaClassesTest-580089113 tempest-VolumeQuotaClassesTest-580089113-project-admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:36:59.973544 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:36:59.974498 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:36:59.974841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:36:59.975212 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] PATH_INFO: `/v3/users/935b39b16c784942866e3f0eb9774921` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:36:59.976426 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935b39b16c784942866e3f0eb9774921)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:00.004549 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:00.190570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935b39b16c784942866e3f0eb9774921'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:00.198792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935b39b16c784942866e3f0eb9774921'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:00.228183 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935b39b16c784942866e3f0eb9774921'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:00.228840 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935b39b16c784942866e3f0eb9774921'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:00.240970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935b39b16c784942866e3f0eb9774921'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:00.247191 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1478/2963] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:36:59 2021] DELETE /identity/v3/users/935b39b16c784942866e3f0eb9774921 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:00.252004 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:00.252358 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:00.252699 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:00.276822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:00.278057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:00.345486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1486/2964] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:00.356305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:00.357742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:00.424013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd69b41-83e0-4d78-818f-c3b3d0417755 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:00.427764 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:00.428409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:00.428746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:00.429077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:00.438439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:00.467030 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:00.476652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1479/2965] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:00.882519 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:00.883996 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:00.895727 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6c61f-a184-4c49-82b5-fb3844fcd091 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:00.900609 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:00.901464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:00.901896 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:00.902156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] PATH_INFO: `/v3/projects/4d1b64f6123940a0a1d2260285abcf33` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:00.903374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1b64f6123940a0a1d2260285abcf33)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:00.932147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:01.030176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1b64f6123940a0a1d2260285abcf33', 'request_id': 'req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.035837 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1b64f6123940a0a1d2260285abcf33', 'request_id': 'req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.062871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1b64f6123940a0a1d2260285abcf33', 'request_id': 'req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.080401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] The token cache is being invalidate because project 4d1b64f6123940a0a1d2260285abcf33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:01.080741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.081404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.083075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1487/2966] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:00 2021] DELETE /identity/v3/projects/4d1b64f6123940a0a1d2260285abcf33 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:01.087842 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:01.097600 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1146-264c-4b2f-97cf-37f8abc60775 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:01.165473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:01.166400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:01.166739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:01.167072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] PATH_INFO: `/v3/users/3b6937423dc34f48ad21d225baa09155` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:01.168295 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6937423dc34f48ad21d225baa09155)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:01.196983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:01.287624 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6937423dc34f48ad21d225baa09155'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.295794 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6937423dc34f48ad21d225baa09155'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.319931 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6937423dc34f48ad21d225baa09155'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.320542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6937423dc34f48ad21d225baa09155'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.333440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-c883fc47-0114-403f-a325-1486dbba586d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6937423dc34f48ad21d225baa09155'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:01.339864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1480/2967] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:01 2021] DELETE /identity/v3/users/3b6937423dc34f48ad21d225baa09155 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:02.181977 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:02.183415 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:02.198287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcbdd2-a5d5-4837-a11c-a8e4bacd1d67 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:02.278035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:02.278946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.279262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.279597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] PATH_INFO: `/v3/projects/5486a76eb4504bc9883cae1d965f0dd0` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.280809 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5486a76eb4504bc9883cae1d965f0dd0)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:02.309818 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:02.412455 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5486a76eb4504bc9883cae1d965f0dd0', 'request_id': 'req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:02.417807 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5486a76eb4504bc9883cae1d965f0dd0', 'request_id': 'req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:02.462616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5486a76eb4504bc9883cae1d965f0dd0', 'request_id': 'req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:02.480730 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] The token cache is being invalidate because project 5486a76eb4504bc9883cae1d965f0dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:02.481057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:02.481775 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-445cfc3e-1a98-4085-8c5b-3a8b1902edf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:02.483346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1488/2968] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:02 2021] DELETE /identity/v3/projects/5486a76eb4504bc9883cae1d965f0dd0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:02.491772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.492124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.492464 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.597341 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:02.598598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:02.666944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1481/2969] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:02.675629 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.675979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.676352 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.700388 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:02.701722 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:02.709910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1489/2970] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:02.714438 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:02.724326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ee203-65df-4946-bc2f-e77156ca1b14 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:02.728952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:02.729619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.730022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.730361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.731149 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:37:02.731505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:02.759940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:02.774077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1482/2971] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:37:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:37:02.778849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:02.788386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329b481-73c0-40bc-9094-c6d1b2311c9f None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:02.793095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:02.793757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.794156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.794493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.795263 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:02.824293 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:02.881639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1490/2972] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:37:02 2021] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:02.886188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:02.897078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294db96a-6d90-4f8e-8c76-fd7e2fe93551 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:02.964782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:02.965394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:02.965738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:02.966097 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:02.966821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:02.995639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.044344 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1483/2973] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:37:02 2021] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:03.048803 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.059993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22392e-b061-4a35-ae58-1cc98fae3f4b admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.064646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.065980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.066321 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.066657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.067466 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.095772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a15b5d-6344-4941-a2a5-a6ebbed9558c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.106619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1491/2974] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:03 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:03.110917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.121262 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d07c82-89ce-44bf-8f69-c61c1a1409ef admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.125739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.126677 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.127031 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.127345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] PATH_INFO: `/v3/projects/b60ad6bc21c6432d9105e694e1f8b702/users/d243d4ce26d74ed3bd079584d38ce083/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.148478 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60ad6bc21c6432d9105e694e1f8b702, user_id=d243d4ce26d74ed3bd079584d38ce083, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.177970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.215411 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1484/2975] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:03 2021] PUT /identity/v3/projects/b60ad6bc21c6432d9105e694e1f8b702/users/d243d4ce26d74ed3bd079584d38ce083/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:03.226881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.227229 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.227561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.265853 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] MFA Rules not processed for user `d243d4ce26d74ed3bd079584d38ce083`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:03.267058 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:03.342863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1492/2976] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:03 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:03.348075 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.418994 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a301-424a-4292-8a03-fdb0dbbc3861 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.423547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.424207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.425083 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.425418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.426168 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.454161 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.509752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1485/2977] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:37:03 2021] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:03.514138 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.525335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69c86b-1e62-4872-ba3e-370bbaec7ea6 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.591647 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.592335 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.592675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.593007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.593726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.623583 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.673398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1493/2978] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:37:03 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:03.678142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.688924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a6f0e-bae2-448d-b5c2-cda0441fdec6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.693657 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.694492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.694833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.695165 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.695942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.726473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.738508 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1486/2979] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:03 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:03.742875 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.752888 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c5a2-28b1-4096-b738-b9b594201d44 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.757406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.758379 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.758720 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.759051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] PATH_INFO: `/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.780346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78380bf70f2459d843bff896fa6fa22, user_id=c71e0836c72c4a0eb3e9c8207abf1b93, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.809795 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:03.878936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1494/2980] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:03 2021] PUT /identity/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:03.883486 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:03.894632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3867edb-fa20-4ef6-bb43-0fbf52d3dea6 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:03.962841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:03.963525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:03.963865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:03.964201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:03.964984 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:03.993885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:04.005267 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1487/2981] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:03 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:04.018679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:04.029855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeed21-ae58-43d0-8e16-388254bdc71c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:04.035007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:04.035854 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:04.036192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:04.036521 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] PATH_INFO: `/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:04.038541 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78380bf70f2459d843bff896fa6fa22, user_id=c71e0836c72c4a0eb3e9c8207abf1b93, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:04.068192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:04.078607 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1495/2982] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:04 2021] PUT /identity/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:04.083554 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:04.093845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c405a-488b-44c6-a8d0-5023084e9de5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:04.161661 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:04.162400 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:04.162745 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:04.163078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:04.163859 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:04.192130 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71e997-4513-458b-88dd-ca136d4b51ed admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:04.202924 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1488/2983] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:04 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:04.208102 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:04.218606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc3efe-0506-4eee-994b-de3e0177167e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:04.223092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:04.224026 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:04.224360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:04.224685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] PATH_INFO: `/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:04.226632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78380bf70f2459d843bff896fa6fa22, user_id=c71e0836c72c4a0eb3e9c8207abf1b93, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:04.256248 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:04.303966 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1496/2984] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:04 2021] PUT /identity/v3/projects/b78380bf70f2459d843bff896fa6fa22/users/c71e0836c72c4a0eb3e9c8207abf1b93/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:04.314596 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:04.315431 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:04.315772 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:04.353222 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] MFA Rules not processed for user `c71e0836c72c4a0eb3e9c8207abf1b93`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:04.354450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:04.431934 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1489/2985] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:04 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:04.442564 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:04.444360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:04.515332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00132d5-ff97-4e85-bcd0-124dd96d20f1 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:04.518992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:04.519646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:04.519983 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:04.520324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:04.585757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:04.613955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62890d1-08b9-4912-a0db-e7d5451531a4 service cinder] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:04.623021 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1497/2986] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:04 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:07.667982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:07.739824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916e75-7185-4133-b268-ee8de0aec654 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:07.744324 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:07.745217 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:07.745550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:07.745920 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] PATH_INFO: `/v3/users/d243d4ce26d74ed3bd079584d38ce083` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:07.747141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d243d4ce26d74ed3bd079584d38ce083)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:07.779378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:07.905243 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd243d4ce26d74ed3bd079584d38ce083'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:07.913968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd243d4ce26d74ed3bd079584d38ce083'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:07.948201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd243d4ce26d74ed3bd079584d38ce083'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:07.948944 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd243d4ce26d74ed3bd079584d38ce083'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:07.961393 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd243d4ce26d74ed3bd079584d38ce083'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:07.968199 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1490/2987] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:07 2021] DELETE /identity/v3/users/d243d4ce26d74ed3bd079584d38ce083 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:07.973360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:07.973710 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:07.974090 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:07.998237 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:07.999461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:08.067135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1498/2988] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:08.079198 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:08.080681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:08.150640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdb61a-fe33-458e-8996-fa25a65a159c admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:08.154371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:08.155029 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:08.155421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:08.155704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:08.165593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:08.193752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:08.203585 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1491/2989] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:08.630177 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:08.631739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:08.645874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2d719-0e36-4587-a114-74c85bdcb26d None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:08.650666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:08.651542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:08.651876 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:08.652247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] PATH_INFO: `/v3/projects/b60ad6bc21c6432d9105e694e1f8b702` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:08.653448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60ad6bc21c6432d9105e694e1f8b702)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:08.681751 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:08.760604 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60ad6bc21c6432d9105e694e1f8b702', 'request_id': 'req-2c003a81-8ac8-45f8-9a73-c011f0c2b426'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:08.765910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60ad6bc21c6432d9105e694e1f8b702', 'request_id': 'req-2c003a81-8ac8-45f8-9a73-c011f0c2b426'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:08.803885 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60ad6bc21c6432d9105e694e1f8b702', 'request_id': 'req-2c003a81-8ac8-45f8-9a73-c011f0c2b426'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:08.821246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] The token cache is being invalidate because project b60ad6bc21c6432d9105e694e1f8b702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:08.821574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:08.822247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:08.823765 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1499/2990] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:08 2021] DELETE /identity/v3/projects/b60ad6bc21c6432d9105e694e1f8b702 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:08.828007 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:08.838504 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272050c9-481a-49a1-af0d-c7f3d595d901 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:08.905861 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:08.906750 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:08.907092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:08.907424 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] PATH_INFO: `/v3/users/c71e0836c72c4a0eb3e9c8207abf1b93` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:08.908638 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71e0836c72c4a0eb3e9c8207abf1b93)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:08.937053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:09.030639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71e0836c72c4a0eb3e9c8207abf1b93'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.038708 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71e0836c72c4a0eb3e9c8207abf1b93'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.062210 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71e0836c72c4a0eb3e9c8207abf1b93'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.062872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71e0836c72c4a0eb3e9c8207abf1b93'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.075565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-f2ba2eb4-52ff-495a-8fde-574d7d9e8389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71e0836c72c4a0eb3e9c8207abf1b93'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.081819 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1492/2991] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:08 2021] DELETE /identity/v3/users/c71e0836c72c4a0eb3e9c8207abf1b93 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:09.484427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:09.485968 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:09.500050 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c003a81-8ac8-45f8-9a73-c011f0c2b426 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:09.565850 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:09.566737 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:09.567074 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:09.567406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] PATH_INFO: `/v3/projects/b78380bf70f2459d843bff896fa6fa22` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:09.568614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78380bf70f2459d843bff896fa6fa22)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:09.597531 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:09.684589 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78380bf70f2459d843bff896fa6fa22', 'request_id': 'req-1e931e4e-66e2-4b94-b181-967b4e1d67d9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.689738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78380bf70f2459d843bff896fa6fa22', 'request_id': 'req-1e931e4e-66e2-4b94-b181-967b4e1d67d9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.730863 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78380bf70f2459d843bff896fa6fa22', 'request_id': 'req-1e931e4e-66e2-4b94-b181-967b4e1d67d9'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.747746 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] The token cache is being invalidate because project b78380bf70f2459d843bff896fa6fa22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:09.748078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.748738 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-1e931e4e-66e2-4b94-b181-967b4e1d67d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:09.750299 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1500/2992] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:09 2021] DELETE /identity/v3/projects/b78380bf70f2459d843bff896fa6fa22 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:09.758318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:09.758672 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:09.759013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:09.782960 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:09.784176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:09.858620 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1493/2993] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:09.866971 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:09.867353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:09.867687 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:09.893314 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:09.895107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:09.903015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1501/2994] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:09.907402 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:09.917986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc606-9a6a-430f-b8e6-8f2adcd66983 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:09.922500 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:09.923154 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:09.923492 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:09.923822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] PATH_INFO: `/v3/domains` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:09.924599 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66162) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:37:09.924949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:09.952619 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:09.969760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1494/2995] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:37:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:37:09.971155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:09.981472 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1e167-0ca4-41ba-bb9e-2c2806c4bc81 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:09.986204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:09.986865 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:09.987205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:09.987538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:09.988269 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.016848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.069917 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1502/2996] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:37:09 2021] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:10.074369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:10.085094 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690d643-fc6f-4117-89c5-4ce680fe4647 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:10.151804 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:10.152488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.152856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.153167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.153926 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.182232 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.239742 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1495/2997] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:37:10 2021] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:10.244041 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:10.255079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807756ff-61a4-44e7-a56f-3c066f13e37e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:10.259669 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:10.260338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.260678 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.261012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.261829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.290616 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de74c4-d610-44aa-a91e-0d57b8419e44 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.301706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1503/2998] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:10 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:10.305963 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:10.316612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bacde-a534-4ebe-9fc2-a7c74371e48b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:10.321095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:10.322020 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.322357 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.322693 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] PATH_INFO: `/v3/projects/6ff1e459a46d42ab90cf8fd513a6ba64/users/dac65103acaf4c69a6d123f472a50f3f/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.343675 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff1e459a46d42ab90cf8fd513a6ba64, user_id=dac65103acaf4c69a6d123f472a50f3f, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.372343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.417123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1496/2999] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:10 2021] PUT /identity/v3/projects/6ff1e459a46d42ab90cf8fd513a6ba64/users/dac65103acaf4c69a6d123f472a50f3f/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:10.428987 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.429331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.429667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.467580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] MFA Rules not processed for user `dac65103acaf4c69a6d123f472a50f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:10.468802 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:10.544773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1504/3000] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:10 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 12:37:10.556109 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:10.557866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:10.624351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ec03a-26b1-40d9-b1c4-cd1efc2bcdb4 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:10.628188 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3cbfabf9954b87b9a13bf68684d0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:10.628916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.629286 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.629640 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.639035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.666881 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fefaff-8f6f-4948-b044-48200e12dcb2 service cinder] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.676392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1497/3001] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:10 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:10.700740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:10.773072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33c664-cfe4-462b-a778-17e3269c3a8c None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:10.777914 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:10.778821 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.779148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.779483 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] PATH_INFO: `/v3/users/dac65103acaf4c69a6d123f472a50f3f` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.780700 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dac65103acaf4c69a6d123f472a50f3f)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:10.810084 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:10.904091 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dac65103acaf4c69a6d123f472a50f3f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:10.912612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dac65103acaf4c69a6d123f472a50f3f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:10.936515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dac65103acaf4c69a6d123f472a50f3f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:10.937174 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dac65103acaf4c69a6d123f472a50f3f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:10.949197 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dac65103acaf4c69a6d123f472a50f3f'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:10.955360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1505/3002] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:10 2021] DELETE /identity/v3/users/dac65103acaf4c69a6d123f472a50f3f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:10.960112 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:10.960463 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:10.960796 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:10.984590 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:10.985845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:11.059032 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1498/3003] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:11.070331 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:11.071760 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:11.138782 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b20b7-8701-4f7c-afab-368a67c274f0 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:11.142452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:11.143099 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:11.143437 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:11.143768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:11.153371 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:11.182364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecf8e6-2bd7-4e92-a348-22eedce9ce09 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:11.192280 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1506/3004] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:11.607313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:11.608856 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:11.620843 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c81a4-61ea-40ac-a2a2-5a01b683d073 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:11.626010 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:11.626878 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:11.627214 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:11.627543 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] PATH_INFO: `/v3/projects/6ff1e459a46d42ab90cf8fd513a6ba64` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:11.629250 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff1e459a46d42ab90cf8fd513a6ba64)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:11.658150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:11.737143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff1e459a46d42ab90cf8fd513a6ba64', 'request_id': 'req-d7e1af07-df61-4067-ae68-e76e58596273'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:11.742428 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff1e459a46d42ab90cf8fd513a6ba64', 'request_id': 'req-d7e1af07-df61-4067-ae68-e76e58596273'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:11.775401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff1e459a46d42ab90cf8fd513a6ba64', 'request_id': 'req-d7e1af07-df61-4067-ae68-e76e58596273'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:11.792117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] The token cache is being invalidate because project 6ff1e459a46d42ab90cf8fd513a6ba64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:11.792443 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:11.793104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-d7e1af07-df61-4067-ae68-e76e58596273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:11.794650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1499/3005] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:11 2021] DELETE /identity/v3/projects/6ff1e459a46d42ab90cf8fd513a6ba64 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:11.800711 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:11.801059 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:11.801429 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:11.825603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:11.826883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:11.895533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1507/3006] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:11.904015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:11.904364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:11.904697 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:11.928340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:11.929525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:11.937247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1500/3007] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:11.942063 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:11.951684 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6410c-44aa-484c-aa9c-9ffc8f24a761 None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:11.956178 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:11.956835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:11.957175 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:11.957505 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] PATH_INFO: `/v3/domains` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:11.958306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66163) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:161}} Aug 21 12:37:11.958656 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:11.986728 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.005239 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1508/3008] 10.222.0.18 () {58 vars in 1143 bytes} [Sat Aug 21 12:37:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 12:37:12.006612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:12.016190 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f8e74-8590-4e90-bea3-cb6022520b7e None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:12.020787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:12.021440 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.021777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.022150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.022872 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:12.052155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.116015 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1501/3009] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:37:12 2021] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:12.120360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:12.131170 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ced47-a91b-4ee1-b986-06d11219c291 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:12.196418 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:12.197089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.197422 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.197749 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] PATH_INFO: `/v3/users` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.198515 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:12.226663 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.274247 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1509/3010] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:37:12 2021] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:12.278849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:12.289930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae42fd-00b4-4f29-91b6-d14d04028b72 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:12.294539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:12.295207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.295546 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.295884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] PATH_INFO: `/v3/roles` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.296671 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:12.325111 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd39ebf-4266-45ec-bf0c-4b2ad207572c admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.335883 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1502/3011] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:12 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:12.339979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:12.350406 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abf424-f071-445d-8ce0-48ce67921999 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:12.354955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:12.355835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] REQUEST_METHOD: `PUT` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.356167 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.356494 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] PATH_INFO: `/v3/projects/d0ff2740855c48bba229d974ad976df0/users/f9e6c3cbd36e4aaf9b999ced4d6b8353/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.377419 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ff2740855c48bba229d974ad976df0, user_id=f9e6c3cbd36e4aaf9b999ced4d6b8353, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:12.406459 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.444151 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1510/3012] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:12 2021] PUT /identity/v3/projects/d0ff2740855c48bba229d974ad976df0/users/f9e6c3cbd36e4aaf9b999ced4d6b8353/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:12.449378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c0a0-81b9-475e-8b86-0623f1b1b470 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.449731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c0a0-81b9-475e-8b86-0623f1b1b470 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.450122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c0a0-81b9-475e-8b86-0623f1b1b470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.473682 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-21e3c0a0-81b9-475e-8b86-0623f1b1b470 None None] MFA Rules not processed for user `2ba5d31461a040c292e70a0ffe9aec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:12.474916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-21e3c0a0-81b9-475e-8b86-0623f1b1b470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:12.543576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1503/3013] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:12.554998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:12.556777 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:12.623124 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8c16-65b3-4ad6-9b6c-55794f384033 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:12.626768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:12.627408 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:12.627797 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:12.628079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:12.638009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:12.666979 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:12.677242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1511/3014] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:18.953206 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:18.954313 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:18.954779 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.032759 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] MFA Rules not processed for user `f9e6c3cbd36e4aaf9b999ced4d6b8353`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:19.033952 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:19.131364 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1504/3015] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:18 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:19.136410 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.146392 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cd6b2-3fcf-4415-afbe-2b2c700d80b1 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.151276 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.151941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.152282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.152614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] PATH_INFO: `/v3/projects` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.153340 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.183135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.236298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1512/3016] 10.222.0.18 () {60 vars in 1143 bytes} [Sat Aug 21 12:37:19 2021] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 12:37:19.240942 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.254176 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e60588-0b9e-49a9-ac3b-a6f0211dd6d1 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.355593 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.356289 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.356632 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.356965 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] PATH_INFO: `/v3/users` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.357706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.395039 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.441650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1505/3017] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Aug 21 12:37:19 2021] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 12:37:19.445956 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.459835 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac04fd4-7966-4849-b963-2deb0c8a8144 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.472082 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.473329 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.474117 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.475060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.476053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.528668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.544089 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1513/3018] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 12:37:19.548432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.560265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400efb1-dc7b-4e3b-a67e-3ed0b526eac5 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.569107 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.570309 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.570725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.571296 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] PATH_INFO: `/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.596182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c6b0a596140ed8e5624d89cb68c61, user_id=567d6535649f46759da3d05d30536c5e, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.626461 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.670053 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1506/3019] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:19 2021] PUT /identity/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:19.674501 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.686524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33eb6f-19f5-4a1a-9724-84344f6a978e admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.764072 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.764787 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.765131 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.765473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.766372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.796547 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.809586 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1514/3020] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:19.815993 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.827646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dc3ab-20e0-449d-917c-06f6830e5cb0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:19.832660 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:19.833612 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:19.834001 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:19.834369 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] PATH_INFO: `/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/90f6703d946e4169827377b5a8ffae62` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:19.836580 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c6b0a596140ed8e5624d89cb68c61, user_id=567d6535649f46759da3d05d30536c5e, role_id=90f6703d946e4169827377b5a8ffae62)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:19.867565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:19.880469 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1507/3021] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:19 2021] PUT /identity/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/90f6703d946e4169827377b5a8ffae62 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:37:19.884957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:19.896407 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f45a4-5d11-4932-a48f-ab5e4b6ef8e7 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:20.026526 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:20.027223 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:20.027561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:20.027897 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:20.028680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:20.063576 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:20.077446 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1515/3022] 10.222.0.18 () {58 vars in 1112 bytes} [Sat Aug 21 12:37:19 2021] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 12:37:20.082279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:20.094346 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f27a3d-a67a-45dc-be66-2c8866b0e013 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:20.107786 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:20.108957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] REQUEST_METHOD: `PUT` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:20.109465 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:20.110013 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] PATH_INFO: `/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/5fc637628e7f40bfa94e77aac032c126` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:20.112281 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c6b0a596140ed8e5624d89cb68c61, user_id=567d6535649f46759da3d05d30536c5e, role_id=5fc637628e7f40bfa94e77aac032c126)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:20.147957 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:20.196141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1508/3023] 10.222.0.18 () {60 vars in 1473 bytes} [Sat Aug 21 12:37:20 2021] PUT /identity/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61/users/567d6535649f46759da3d05d30536c5e/roles/5fc637628e7f40bfa94e77aac032c126 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:20.679559 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:20.763306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d12d-00f9-482a-85bc-1093f2234b4f admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:20.899614 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:20.900287 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:20.900628 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:20.900959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:20.902884 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:21.048940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:21.097351 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:21.114666 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1516/3024] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:20 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:22.713667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:22.715792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:22.739550 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c4cae-94fa-4fee-b102-6b8a4c34c98f admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:22.749891 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:22.750793 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:22.751240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:22.751679 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:22.762820 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:22.793927 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:22.846326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d38a43-d354-45e3-af94-f5c085e768f8 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:22.864895 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1509/3025] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:22 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:27.160789 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:27.171294 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff909c4-fd83-4e4e-b7ff-db32b11f0ecd service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:27.180603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:27.181290 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:27.182009 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:27.182667 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:27.188799 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:27.282079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:27.316976 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:27.328348 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1517/3026] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:27.696353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be32a-517b-42d1-8a60-fdfedba1f760 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:27.697509 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be32a-517b-42d1-8a60-fdfedba1f760 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:27.698184 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3be32a-517b-42d1-8a60-fdfedba1f760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:27.744012 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-ff3be32a-517b-42d1-8a60-fdfedba1f760 None None] MFA Rules not processed for user `567d6535649f46759da3d05d30536c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:27.745264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ff3be32a-517b-42d1-8a60-fdfedba1f760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:27.829866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1510/3027] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:27 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:27.844160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:27.844982 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:27.933922 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9a090-3f5b-46cb-b4c4-aaf7b4679b69 service neutron] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:27.938282 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae4fdee19f3c4821b3831f77f2273d52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:27.939205 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:27.939552 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:27.939886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:28.043836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:28.072391 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:28.083057 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1518/3028] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:27 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:28.313060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6755-ff73-4736-a4e3-8f8142ff5cf0 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:28.313561 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6755-ff73-4736-a4e3-8f8142ff5cf0 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:28.313776 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae6755-ff73-4736-a4e3-8f8142ff5cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:28.399523 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-1bae6755-ff73-4736-a4e3-8f8142ff5cf0 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:28.400873 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-1bae6755-ff73-4736-a4e3-8f8142ff5cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:28.488560 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1511/3029] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:37:28 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:28.624236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:28.625886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:28.757398 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c37e0-02ff-41e5-8fb3-a893e2e0b616 service glance] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:28.764104 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:28.765724 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:28.766103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:28.766450 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:28.779378 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:28.815692 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:28.832514 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1519/3030] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:37:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:37:41.214811 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:41.215291 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:41.215513 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:41.239452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] MFA Rules not processed for user `f9e6c3cbd36e4aaf9b999ced4d6b8353`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:41.240686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:41.247702 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1512/3031] 10.222.0.18 () {58 vars in 948 bytes} [Sat Aug 21 12:37:41 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:42.219457 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:42.221822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:42.300078 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a8e1-6447-40d1-88fe-2369e258e46a service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:42.310824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:42.311493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:42.311871 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:42.312201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:42.314142 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:42.326783 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:42.355337 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:42.366302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:42.367471 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1520/3032] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:42.367726 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:42.381555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5835a-6a01-4579-ad4e-25df583c464d None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:42.386156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:42.387036 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:42.387374 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:42.387704 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] PATH_INFO: `/v3/users/8bfaff746ba147c189999b23de62a49d` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:42.388905 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfaff746ba147c189999b23de62a49d)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:42.418160 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:42.477156 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:42.478721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:42.491524 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f852c-ef4f-4463-bd8d-09bf3f72ed67 service placement] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:42.497125 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:42.497770 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:42.498162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:42.498493 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:42.500234 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:42.512302 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:42.533597 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfaff746ba147c189999b23de62a49d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:42.541157 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:42.542152 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfaff746ba147c189999b23de62a49d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:42.551373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1521/3033] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:42 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:37:42.576311 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfaff746ba147c189999b23de62a49d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:42.576981 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfaff746ba147c189999b23de62a49d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:42.590725 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfaff746ba147c189999b23de62a49d'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:42.597273 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1513/3034] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:42 2021] DELETE /identity/v3/users/8bfaff746ba147c189999b23de62a49d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:42.855955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:42.869051 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fc595-7dd4-4c12-8bc0-ba7a288bf337 service placement] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:42.937421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:42.938332 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:42.938673 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:42.939006 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] PATH_INFO: `/v3/projects/d1f4b0c579c548ad8f6cdef61c56b13a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:42.940912 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f4b0c579c548ad8f6cdef61c56b13a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:42.969829 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:43.058162 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f4b0c579c548ad8f6cdef61c56b13a', 'request_id': 'req-ed0c1323-fdec-4448-a753-d0333dae2e09'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.063474 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f4b0c579c548ad8f6cdef61c56b13a', 'request_id': 'req-ed0c1323-fdec-4448-a753-d0333dae2e09'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.090542 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f4b0c579c548ad8f6cdef61c56b13a', 'request_id': 'req-ed0c1323-fdec-4448-a753-d0333dae2e09'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.108731 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] The token cache is being invalidate because project d1f4b0c579c548ad8f6cdef61c56b13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:43.109060 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.109739 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.111330 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1522/3035] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:42 2021] DELETE /identity/v3/projects/d1f4b0c579c548ad8f6cdef61c56b13a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:43.116377 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:43.117998 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:43.130992 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe51779-606e-4505-ab65-0e777cd44b57 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:43.200685 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:43.201910 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:43.202383 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:43.202830 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] PATH_INFO: `/v3/users/258657942f4e4375b9a241ed57999b92` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:43.204179 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258657942f4e4375b9a241ed57999b92)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:43.234394 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:43.389279 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258657942f4e4375b9a241ed57999b92'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.398143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258657942f4e4375b9a241ed57999b92'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.432990 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258657942f4e4375b9a241ed57999b92'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.433766 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258657942f4e4375b9a241ed57999b92'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.446833 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ff688f84-c384-4bb5-95b3-a97f527b3768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258657942f4e4375b9a241ed57999b92'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.453195 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1514/3036] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:37:43 2021] DELETE /identity/v3/users/258657942f4e4375b9a241ed57999b92 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:43.719555 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:43.721707 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:43.735092 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c1323-fdec-4448-a753-d0333dae2e09 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:43.801448 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:43.802345 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:43.802686 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:43.803019 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] PATH_INFO: `/v3/projects/e0df3fe177eb415495982ae0315fa667` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:43.804242 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0df3fe177eb415495982ae0315fa667)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:43.833694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:43.909538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0df3fe177eb415495982ae0315fa667', 'request_id': 'req-8446eefb-dc88-40b2-8628-e412e64344fe'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.914916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0df3fe177eb415495982ae0315fa667', 'request_id': 'req-8446eefb-dc88-40b2-8628-e412e64344fe'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.947591 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0df3fe177eb415495982ae0315fa667', 'request_id': 'req-8446eefb-dc88-40b2-8628-e412e64344fe'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.966272 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] The token cache is being invalidate because project e0df3fe177eb415495982ae0315fa667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66163) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:37:43.966602 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.967834 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:37:43.969658 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1523/3037] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:37:43 2021] DELETE /identity/v3/projects/e0df3fe177eb415495982ae0315fa667 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:37:44.635574 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] REQUEST_METHOD: `POST` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:44.636046 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:44.636246 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:44.660326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66162) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:37:44.661539 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:44.739986 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1515/3038] 10.222.0.18 () {58 vars in 999 bytes} [Sat Aug 21 12:37:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:37:44.753664 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:44.755187 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:44.838453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446eefb-dc88-40b2-8628-e412e64344fe admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:44.843409 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:44.844064 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:44.844404 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:44.844740 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:44.854317 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:44.883359 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:44.892427 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1524/3039] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:37:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:37:56.848171 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:37:56.849652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:56.918650 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b63d3e-ed84-4ef2-a6f6-92affbf8d180 None None] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:37:56.922216 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:37:56.922866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:37:56.923202 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:37:56.923532 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:37:56.925921 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:37:56.935556 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:37:56.963866 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:37:56.972849 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1516/3040] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:37:56 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:38:04.430401 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:04.431941 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:04.519967 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb14b6-667a-4476-888b-ad0e845d7077 service swift] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:04.526211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:04.526864 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:04.527204 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:04.527533 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:04.529372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:04.542347 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:04.570386 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:04.580752 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1525/3041] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:38:04 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:38:17.480489 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:17.489598 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf0d51-33fd-41dd-bbff-9d604247d919 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:17.494473 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:17.495236 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:17.495578 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:17.495911 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:17.497748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:17.571558 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:17.599024 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:17.609343 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1517/3042] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:38:17 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:38:19.829278 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:19.830841 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:19.848136 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484598b-90b0-44c3-9b89-b6ad7e93d404 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:19.856147 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd950460ecfe846a7ab6f4933bd97454e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:19.857373 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:19.857721 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:19.858298 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:19.860355 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:19.876606 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:19.910132 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:19.923855 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1526/3043] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:38:19 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:38:27.430635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:27.439961 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298df64-9c54-4f1f-92d8-fb8d72d93bfd service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:27.443615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '294019491b31446c8f92c072f351de93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:27.444266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:27.444605 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:27.444939 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:27.446792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:27.520488 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:27.549801 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:27.559943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1518/3044] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:38:27 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:38:39.872800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:39.874319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:39.888211 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98d612-726d-401c-a621-c1ff6d3dafe4 service nova] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:39.892689 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:39.893565 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:39.893935 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:39.894265 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] PATH_INFO: `/v3/users/1140a3e552794d0892bc7fcb5535c9e2` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:39.895453 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1140a3e552794d0892bc7fcb5535c9e2)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:39.928810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:40.029694 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1140a3e552794d0892bc7fcb5535c9e2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.037972 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1140a3e552794d0892bc7fcb5535c9e2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.070680 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1140a3e552794d0892bc7fcb5535c9e2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.071403 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1140a3e552794d0892bc7fcb5535c9e2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.083824 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1140a3e552794d0892bc7fcb5535c9e2'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.090637 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1527/3045] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:38:39 2021] DELETE /identity/v3/users/1140a3e552794d0892bc7fcb5535c9e2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:38:40.423630 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:40.434201 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e274f-f676-4a41-a01f-37a8258add58 service neutron] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:40.500551 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:40.501432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:40.501768 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:40.502141 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] PATH_INFO: `/v3/projects/7c0722379d3d4d2db7faa647c0e06819` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:40.503342 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0722379d3d4d2db7faa647c0e06819)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:40.532182 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:40.627874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0722379d3d4d2db7faa647c0e06819', 'request_id': 'req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.633706 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0722379d3d4d2db7faa647c0e06819', 'request_id': 'req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.660955 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0722379d3d4d2db7faa647c0e06819', 'request_id': 'req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.679306 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] The token cache is being invalidate because project 7c0722379d3d4d2db7faa647c0e06819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:38:40.679635 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.680305 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.681901 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1519/3046] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:38:40 2021] DELETE /identity/v3/projects/7c0722379d3d4d2db7faa647c0e06819 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:38:40.686264 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:40.687748 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:40.700615 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f3ba5-af28-4b26-9d2c-ca0f37f9d897 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:40.765150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:40.766079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:40.766417 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:40.766747 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] PATH_INFO: `/v3/users/e14db2b0d9aa44249a4320d77a06f47a` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:40.767943 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14db2b0d9aa44249a4320d77a06f47a)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:40.796949 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:40.895936 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14db2b0d9aa44249a4320d77a06f47a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.904353 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14db2b0d9aa44249a4320d77a06f47a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.930003 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14db2b0d9aa44249a4320d77a06f47a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.930608 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14db2b0d9aa44249a4320d77a06f47a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.942767 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-dbdc2949-e6c4-4bd3-9d2a-e9fd5dbf52f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14db2b0d9aa44249a4320d77a06f47a'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:40.949022 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1528/3047] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:38:40 2021] DELETE /identity/v3/users/e14db2b0d9aa44249a4320d77a06f47a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 12:38:41.203023 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:38:41.204518 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:38:41.218266 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670b4e8-2084-4a2e-9c0e-3a325b15e3bc admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:38:41.284479 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:38:41.285361 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:38:41.285701 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:38:41.286088 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] PATH_INFO: `/v3/projects/4948701c7e6f47229b4626338aaedc44` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:38:41.287338 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4948701c7e6f47229b4626338aaedc44)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:38:41.316079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:38:41.388356 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4948701c7e6f47229b4626338aaedc44', 'request_id': 'req-13f78966-bd29-43d2-aa51-b67ac2c79cf3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:41.393649 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4948701c7e6f47229b4626338aaedc44', 'request_id': 'req-13f78966-bd29-43d2-aa51-b67ac2c79cf3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:41.430741 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4948701c7e6f47229b4626338aaedc44', 'request_id': 'req-13f78966-bd29-43d2-aa51-b67ac2c79cf3'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:41.447845 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] The token cache is being invalidate because project 4948701c7e6f47229b4626338aaedc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:38:41.448122 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:41.448784 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:38:41.450432 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1520/3048] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:38:41 2021] DELETE /identity/v3/projects/4948701c7e6f47229b4626338aaedc44 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:39:43.311035 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] REQUEST_METHOD: `POST` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:43.311528 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:43.311681 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:43.358946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.auth.core [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] MFA Rules not processed for user `7a65d2ef73b4425583ec25dbe6301097`. Rule list: `[]` (Enabled: `True`). {{(pid=66163) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:442}} Aug 21 12:39:43.360325 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:39:43.449077 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1529/3049] 10.222.0.18 () {58 vars in 958 bytes} [Sat Aug 21 12:39:43 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 12:39:43.495328 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:39:43.496930 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:39:43.606318 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78966-bd29-43d2-aa51-b67ac2c79cf3 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:39:43.611525 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '548a40dbc77541399c25dd99e88ec169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:39:43.612192 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:43.612538 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:43.612874 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:43.621773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:39:43.650980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:39:43.659372 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1521/3050] 10.222.0.18 () {60 vars in 1375 bytes} [Sat Aug 21 12:39:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 12:39:57.054836 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:39:57.056326 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:39:57.179140 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531deee2-f996-4981-9ada-fdb0ada332bc None None] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:39:57.183723 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:39:57.184617 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:57.184959 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:57.185292 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] PATH_INFO: `/v3/users/f9e6c3cbd36e4aaf9b999ced4d6b8353` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:57.186520 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e6c3cbd36e4aaf9b999ced4d6b8353)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:39:57.215043 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:39:57.453456 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e6c3cbd36e4aaf9b999ced4d6b8353'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:57.461648 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e6c3cbd36e4aaf9b999ced4d6b8353'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:57.503150 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e6c3cbd36e4aaf9b999ced4d6b8353'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:57.503810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e6c3cbd36e4aaf9b999ced4d6b8353'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:57.516103 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e6c3cbd36e4aaf9b999ced4d6b8353'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:57.523135 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1530/3051] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:39:57 2021] DELETE /identity/v3/users/f9e6c3cbd36e4aaf9b999ced4d6b8353 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:39:57.869639 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:39:57.880906 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6a60-3e7e-4b43-a932-a8df92b71a66 service swift] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:39:57.947101 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:39:57.947970 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:57.948319 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:57.948652 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] PATH_INFO: `/v3/projects/d0ff2740855c48bba229d974ad976df0` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:57.949890 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ff2740855c48bba229d974ad976df0)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:39:57.978980 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:39:58.082148 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ff2740855c48bba229d974ad976df0', 'request_id': 'req-81dcf043-729a-4f6b-98cf-2396ae3514f0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.088095 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ff2740855c48bba229d974ad976df0', 'request_id': 'req-81dcf043-729a-4f6b-98cf-2396ae3514f0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.171848 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ff2740855c48bba229d974ad976df0', 'request_id': 'req-81dcf043-729a-4f6b-98cf-2396ae3514f0'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.189173 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] The token cache is being invalidate because project d0ff2740855c48bba229d974ad976df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:39:58.189507 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.190207 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.191773 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1522/3052] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:39:57 2021] DELETE /identity/v3/projects/d0ff2740855c48bba229d974ad976df0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:39:58.196548 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:39:58.198037 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:39:58.211603 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c933f51-f00c-4795-a685-117e3b5248d3 admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:39:58.277643 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:39:58.278570 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:58.278916 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:58.279249 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] PATH_INFO: `/v3/users/567d6535649f46759da3d05d30536c5e` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:58.280468 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=567d6535649f46759da3d05d30536c5e)` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:39:58.309155 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:39:58.434716 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567d6535649f46759da3d05d30536c5e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.443698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567d6535649f46759da3d05d30536c5e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.474698 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567d6535649f46759da3d05d30536c5e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.475360 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567d6535649f46759da3d05d30536c5e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.487668 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567d6535649f46759da3d05d30536c5e'} {{(pid=66163) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.495000 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1531/3053] 10.222.0.18 () {58 vars in 1214 bytes} [Sat Aug 21 12:39:58 2021] DELETE /identity/v3/users/567d6535649f46759da3d05d30536c5e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:39:58.745951 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:39:58.747439 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:39:58.760233 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf043-729a-4f6b-98cf-2396ae3514f0 admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:39:58.826495 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba5d31461a040c292e70a0ffe9aec5b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ce60da1aac441c9b29c109feb2ce1b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:39:58.827421 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:39:58.827744 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:39:58.828079 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] PATH_INFO: `/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:39:58.829350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1c6b0a596140ed8e5624d89cb68c61)` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:39:58.858350 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:39:58.946189 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1c6b0a596140ed8e5624d89cb68c61', 'request_id': 'req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.951462 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1c6b0a596140ed8e5624d89cb68c61', 'request_id': 'req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:58.986123 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1c6b0a596140ed8e5624d89cb68c61', 'request_id': 'req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b'} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:59.004814 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] The token cache is being invalidate because project 6a1c6b0a596140ed8e5624d89cb68c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66162) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 12:39:59.005143 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:59.005900 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.notifications [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66162) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:357}} Aug 21 12:39:59.007512 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1523/3054] 10.222.0.18 () {58 vars in 1223 bytes} [Sat Aug 21 12:39:58 2021] DELETE /identity/v3/projects/6a1c6b0a596140ed8e5624d89cb68c61 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 12:40:08.495365 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Authenticating user token {{(pid=66163) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:40:08.496810 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:40:08.604240 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9261a-d154-4428-9cc5-c1f4c34cb21c admin admin] Validating token access rules against request {{(pid=66163) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:40:08.671800 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66163) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:40:08.672452 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] REQUEST_METHOD: `GET` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:40:08.672792 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] SCRIPT_NAME: `/identity` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:40:08.673126 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66163) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:40:08.674946 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66163) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:40:08.685844 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:40:08.714886 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0ad2-08b7-45fd-ae41-dafb06ac334b service placement] RBAC: Authorization granted {{(pid=66163) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:40:08.724709 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66163|app: 0|req: 1532/3055] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:40:08 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 12:45:11.621257 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Authenticating user token {{(pid=66162) process_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 12:45:11.622822 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.fernet_utils [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66162) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:289}} Aug 21 12:45:11.639480 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1fa10-25ab-4647-8bf6-d1db8c930e3b admin admin] Validating token access rules against request {{(pid=66162) validate_allowed_request /usr/local/lib/python3.6/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 12:45:11.646038 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb3b883c2164df9b87386f1cecb0972', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '344839d838b6439a85fb04b24083ffbf', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66162) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 12:45:11.646940 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] REQUEST_METHOD: `GET` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 12:45:11.647447 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] SCRIPT_NAME: `/identity` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 12:45:11.648002 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66162) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 12:45:11.658646 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:442}} Aug 21 12:45:11.687954 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8391de-38ea-4cc9-8de3-7c2d05cb3011 service placement] RBAC: Authorization granted {{(pid=66162) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 12:45:11.699757 dv-cinder-805477-2-iscsi devstack@keystone.service[66161]: [pid: 66162|app: 0|req: 1524/3056] 10.222.0.18 () {60 vars in 1356 bytes} [Sat Aug 21 12:45:11 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)